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ABSTRACT 

A Study in 18 schools in the Alum Rock (California) 
Union Elementary School District investigated the educational effects 
of differential distribution of^ compensatory resources and services 
to educationally disadvantaged pupils. The study focused on the 
relative effects on reading skills of two methods for resource 
targeting: (1) concentration, or the targeting of additional 
resources and services only to those pupils who meet the entitlement 
criteria in a school; and (2) saturation, or the distribution of 
additional resources and services to any and all pupils in the 
school. In addition, the study investigated' the contextual and 
instructional conditions that might account for differences in 
reading skills. Classroom observations were conducted to examine (1) 
types of teacher and student activities; (2) time spent on 
instruction; (3) . teacher-pupil interaction; (4) materials; (5) 
teachers' interpersonal styles; (6) instructional modes; and (7)' 
group size. Data analysis indicated that concentrated services 
produced higher qtiean reading scores than saturated Services among 
fourth graders, although no sidnificant differences were found among 
second-graders; and that more t^ime spent in. noninstructional 
activities tended to lower reading scores. In general, however, \he 
analysis did not identify the in^structional components associated 
with the benefits of concentrated compensatory services. 
(Author/MJL) 
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INTRODUCTION 

GENERAL 

This report presents the findings of a study of the relative educational effects 
of differential distribution of compensatory resources and services to education- 
ally disadvantaged pupils in the Alum Rock Union Elementary School 'District. The 
Nati^onal Institute of Education ^NIE) sanctioned and supported this study as part 
of a study of improvements in ESEA Title I. Additional authorization came from 
State and local agencies. Alum Rock Union Elementary School District participated 
as one of 11 national demonstration sites with specific interest in assessing the 
relative educational effects of variations in school wide targeting of compensatory 
services. The effects of the concentration and saturation methods provides the 
general focgs of this report. 

Tv;o methods for resource targetinj^were designed to satisfy the study objective: 

(a) Concentration— or the targeting of additional resources and services 
only to those pupils who meet the entitlement criteria in a school . 

(b) Saturation — or the distribution of additional resources and services 
to any and all pupils in a school. 

The data base used in assessing the relative effects of these two resource provision 
conditions was provided by establishing a matched sample of 18 schools which were 
randomly assigned to "saturation" or "concentration" of EDY resources. In the Fall 
of 1976 (school year 1976-77), administration and faculty at each school were 
provided guidelines for implementation of their respective resource treatment: 
concentration or saturation. To avoid administrative and legal problems associated 
with compensatory programs, necessary waivers from State and Federal agencies were 
solicited and obtained prior to actual implementation of the treatment. In fact, 
resources from these waived programs (ECE, SB90 and Title I) were pooled at the 
district level and reallocated to participating buildings on a direct EDY targeting 
basis. Therefore, a uniform. EDY resource share per pupil was established, and the 
number of EDY pupils in a given building determined the resource allocation (i.e.« 
number of shares) for that building. It should be noted that a popil was defined 
as EDY based on reading performance on a standardized achievement test: viz. at or 
below the 50th percentile on the Metro 70 (Harcourt, Brace, Jovanovich, 1972). 

.ERiC V 1. 



Many issues contemplated by this study are extremely complex. To address those 
Issues, a multi faceted. research model was designed consisting of tv/o components: 
. The Observational Component , and the Analysis of Effect / The following questions 
provided guidance in the design and implementation of the research model: 

General Questions : I 

* 1. Does saturation or concentration of compensatory resources 

• and services relate to meaningful and reliable differences 
in ba.sic reading skill acquisitions for either EDY pupils, 

-- non^DY pupils, or both? 

2. From- a logistical standpoint, What is the utility of 
saturation vs. concentration as a means for improvement 
in the acquisition of reading skills? 

3. To what extent do indicators of concentration vs. 
saturation relate to impr()vements in the acquisition 
of reading skills by EDY pupils? 

^4. To what extent does saturation vs. concentration produce 
general educational benefits, in terms of overall 
(class level) achievement in reading skills? 

5. What are the implications of findings from this study for: 

1) Inservicing policy at the District level? 

2) Guidelines for targeting and coordination/integration 
of overlapping programs at the State level? 

3) Resource allocation,' targeting and compensatory service 
policy guidelines at the Federal level? 

6. What are the implications of unanticipated findings (or lack 

« 

of anticipated findings) for designing follow-up studies, 
including reanalyses of the current data? 
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Ob^fervational Questions 

1. What are the resources and processes used for reading Instruction? 

2. How are these processes and resources used differently in saturated 
vs. concentrated classes? l 

•3. Do teachers use different materials and/or methods with-koY as 
opposed to non-EDY pupils? ^n the concentrated class? Tn the 
saturated class? - 

4. What are the contextual arvd^ procedural (instructional) 
conditions which account for differences in reading skill 
attainment? 

5. How were the guidelines for concentration or saturation of 
compensatory services and resources actually implemented in 
the demonstration schools as manifest by instructional and 
administrative staff attitudes and behaviors? 

Analysis Questions 

1. What are the more salient characteristics (in a statistical, sense) 
of teacher- effectiveness, in terms developed by this study, and 
how do these effectiveness characteristics compare with those 
identified through other studies? 

2. What are the important resources and service components and their 
use configuration which best accounts for improved reading 

skill attainment among EDY pupils? ' 

3. How do instructional effects or saturation vs. concentration 
differ at individual pupil vs. class aggregated levels? That is, 
to what extent must class (or school) context variable be taken 
into account in understanding the impacts of the implementation 
of resource and service? ^ J 



This report presents discussions pertaining to the two components of the research 
mode. In addition, a brief summation of the overall findings is presented. 

OVERVIEW OF OBSERVATIONAL COMPONENT 

i ■ 

The -observational component of the research model was designed toraccomplish three 
general objectives. First, a description of the resources and processes tised during 
reading instruction was desired. Secondly, difference in how the two treatments 
(concentration vs. saturation) were implemented was to be observed in terms of what 
resources and processes were used. Finally, instructicmal process variables were 
generated and defined to become part of the basis^fojr analysis in the analytical 
component. 

To accomplish these ends, observation model wa|s developed consisting of two observa- 
tion instruments: classroom observation Tre/tment and individual Student Instrumeht 



The CLASSROOM OBSERVATION INSTRUMENT vi^iS designed to obtain information about \ 
activities and materials used by the teacher and the class as a unH. Most of 
; the observations focused on both the teacher's interaction wi/th the students and 
how^he teacher utilized the materials in the classroom. / T^e instrument consisted 
of two ten-minute teacher-focused observations episodes, sej^rated by c ten-minute 
observation focusing on the class in general. Mos't of the information for study 
purposes was obtained during the teacher- focused observation. 

During the classroom observation, the observer examined the relationships between 
EDY funding strategies and patterns of classroom processes such as teacher decision 
making; teacher role orientation, classroom content, classroom organization, and 
patterns of student interaction with staff, other students, and material resources. 
This instrument examined classroom implementatloln patterns in termslof the 
relationship between funding strategy (treatment) and student outcor^es^* The 
classroom observation instrument provided a depiction of differences*^ in student 
classroom experiences under the two funding conditions, and a determination of the 
relationship between the differences in classroom processes and student outcomes 
under the two funding conditions. This instrument did not contem|late general - 
Izations about funds in any given school or classroom sir}ce the analysis was 
designed for district wide results. 

♦Measures of student outcomes were gathered from studemt scores on achievement 
tests (n=2,100), teacher assessment of the proportion of students' objectives 
accomplished for a small portion of the class, and/observation of task engagement. 



The INDIVIDUAL STUDENT INSTRUMENT was designed to obtain information about how 
specific students were Involved in class activities and what material* these 
students used. The observer focused on individual students who were pre-selected 
according to grade level, sex, ethnicity, EDY status anid the type of class treat- 
ment in which the students were involved. Each of four students -per classroom 

was- observed for approximately 30 minutes. r 

/ • 

"» 

The^individual student observations, were designed to obtain information describing 
instructional resources and' processes us^d by teachers in the two treatment con-> 
ditions. Unlike the teacher-focused observations, the individual student observa- 
tions provided unique information about the implementation of the saturated or 
concentrated treatment, specifically, in determining how teachers differentiate 
resources and processes used on the basis of pupil's EDY status. ^ ^ 

During the individual student observation, the observer examined the relationships 
between EDY funding strategies and patterns of student interactions wit^|^n the 
class. The observer noted student role orientation, how student was involved in 
classroom group;i^ng, how student used funded resources and additional relationships 
and patterns concerning student use of EDY materials and resources. ' 

The combined information obtawed from the use of these two observation .instruments 
provided for the generation of instructional process variables. These variables 
were part of the data base for the analytical component of the research model. 

OVERVIEW OF ANALYTICAL COMPONENT 1 

Two basic Issues guided the analysis of study data for evidence of treatment 
effects: . , 

1) Does saturation ar concentration of compensatory resources and services-- 
to the extent such occurred in this study— relate to reliable and - 
meaningful differences in basic reading skill attainment? , 

2) What are the contextual and procedural (instructional) conditions 
, ' which account for differences in reading skill attainment, if- 

The first question focuses on the effectiveness of the implementation of the two 
treatments. More succinctly, which treatment of allocating educational resources 
and services provides the highest pupil reading achievement? 



An additional objective was to determine the central and peripheral effects of the 
allocations of these treatments on class practices and pupil learning. (reading, 
as measured by MAT). The second analysis question focuses on the more general 
domain of instructional effects. The objective here was to determine what the 
characteristics of pupils, resburces, and instructional procedures which taken to- 
gether, accounted for, learning outcomes (i.e. , reading skills, as^ measured by the 

mat:)." 

To properly address these two issues \and the other general study issues, the 
analysis was divided into four parts. Part I contains a discussion about the 
develo^nent of analysis variables. Part II contains an, examination of the data 
for evidence of effects due to saturation or concentration, using data collected 
at the class-level. Results of these analyses are reported separately for the 
second eind fourth grades. Part lil contains an extension of the analysis to 
include information on the relaltive effects of the tv/o alternative modes of 
delivering compensatory resources and services at the individual pupil level. 
This provides an examination of pre-post test patterns in terms of degree of 
educational disadvantage, ethnicity, gender, and the interactions of these 
conditions with the alternative "treatments" as implemented by the teachers. 
Finally, Part IV deals with the more general question of how this information 
regarding contextual and instructional processes used in the class explain out- 
comes observed' at the class level. 

In Part I, statistical tests of probability were used in the effects of saturation 
vs.. concentration; however, greater emphasis was placed on identifying and better 
understanding the proximal (near) and distal (far) consequences of this attempted 

J' 

intervention. Additional emphasis was placed on evaluating such effects against 
alternative ijnput-process-outcome patterns detected in the data. Variables designed 
to accomplish these analyses were derived from consideration of the fundamental 
issues regarding saturation vs. concentration of compensatory resources and the 
results of contemporary teacher effectiveness research. 

In Part II, the information obtained either during the classroom observations, 
through interviews and test data, or through additional methods vfiis scrutinized 
to determine whether complete data on all relevant measures were available for ' 
each class. The requisite complete data \set was found for 56 of the teacher/class 
units observed. \ 



Two types of conditional analysis Were subsequently^ performed on /these data. Both 
types are based on the general linear hypothesis. First, two-waj)[ analyses of 
covariance/]iiere performed on each of the four' outcome variables (total reading, 
wort >n6v^^ subscore, word analysis subscore, and rea^ng subscore) within 
grade level (second and fourth). The treatment condition (saturated or concentrated) 
was- used as the bet^^en-group variable. The five context or proqess measures which 
showed the closest relationship were treated as covariables. Secondly, multiple 
lirfear regressions were performed. on these data. The mean reading achievement 
scores were regressed on several combinations of context and process variables to 
^identify the most significant determinants of outcome score variance. Through this 
analytical techniqije, an assessment of the instructional effects of several process 
variables was possijble when the effects of context variables were sufficiently 
controlled. 

In Part III, multiple linear^ regressions were performed on samples within grade- 
level to identify reliable context and process covariates of pupil achievement. 
The fifvailable measures for each pupil include^d pVescore (previous MAT standard 
scores for sub and toial tests^), design variables (EDY status, resource treatment, 
ethnicity, gender, and a set of process ^ot>ieriation descriptors. Consequently, 
within each grade level post-scores were regressed on available process and context 
variables, including \the corresponding prescbfe. The identification of relevant 
process covariates of outcomes was enhanced by attaching differential weight 
factors to the process variables in the stepwise procedures. 

In Part IV, additional analysis was performed to attempt to evaluate the instructional 
components and other features associated with the possible benefits (in terms of 
reading achievement) of concentrating compensatory services and resources. To 
facilitate the analyses and evaluation of these features, a series of, stepwise 
multiple linear regressions were performed on outcome measu-es within each grade- 
level sample. Basically, this analysis attempts to discover what are the process 
and context characteristics at %he classroom level which best account for differences 
in mean achievement? 
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THE OBSERVATION ^OMPONENT 



The observational phase of this study was designed to achieve three 

/ ■ . ■ ' 

V objectives: 

- To describe and define resources and processes used for ^ 
reading instruction; 

- ■ i ' 

7 To detect differences in >^ow the resources and proces;3es ; 

- are used between the sati^rated and concentrated classes 
and to determine how these differences are related to the 

; ^ implementation of thf two treatments; 

1 ' - To generate instructional process variables which, whfen 
I integrated with interview and test data, provide a basis 

for studying the relationships between the processer 
used and the pupil outcomes. (See Analysis of Effects sectj^oii' 
fot discussion of process/outcome study,) * 

The findings telAting to these objectives are presented in this section. Additional 

analyses utilizing these findings are discussed in subsequent chapters. 

All observations were conducted during reading instruction. The rationale 

for this is twofold. The ptimary reason^^is basically methodological. Since one of 

the objectives was to determine differences both within and between class treatment 

types (e.g., differences between individual children, variations over time), it was 

necessary to minimiz^the inherently convoluted effects on the data which would have 

resulted had the observations also been taken during math, science or art instruction 

The second reason is primarily political. The relative success or failure o£ 

\ • , ■ *' . * 

providing basic reading skills to elementary students is presently a topic oi 

\ 

widespread attention and concern. Conseqtiently, improving the effectiveness of 
reading instruction remains a high priority for Title I and other compensatory 
education programs. 

Two observation instruments were developed for this study. The CIJiSSROOM 

V 

OBSERVATION INSTRUMENT was designed to obtain information about the activities and 
materials used by the teacher and the classes a unit. Most of the^observations 
focused on both the teacher's interaction with the students and how the teacher used 
the materials in the classroom. The INDIVIDUAL STUDENT INSTRUMENT was designed to 
obtaiji information about how specific students "were involved in these or other 



activities and what materials those students used* This combined observation 
procedure provided a multiple perspective on the phcnonie]^?^^^_^ding Instruction 
as it occurred within the second and fourth grade classrooms. 



■ Observer Training and Reliability 
: Six substitute teachers participated as otservers for this ^dy alo.ng with 
two wipervisory observers. The six were selected based on these criteria: analytical 
skills, superior memory, prior classroom observation experience, the ability to 
objectively ^tay within the study's definitional bounds, and a willingness rb work ' 
unusual pa^rt-time hours. , . 

Each observer received a minimum 100 hours of training before taking observation 
in the classroom. The training involved lecture discussions, homework and review 
Of each section of the instruments.^ Role playing- and classroom' video tape analysis 
supplemented these activities. ' ^ 

y In addition, the observers. conducted practice observations in over 30 

different classrooms. During these practice sessions, the reliability of the 
observer was evaluated. The observer had to attain at least 90% proficiency on the 
reliability test in order to coxitixjjie in the study. The reliability of observer was 
eva4.uated throughout the study. 

Unfortunately, insufficient time had been allocated to test the six observers 
for reliability, and it wa^^^iec^ssary to extend this testing process into the first 
week of the actual observations. Consequently, to &s^^^ reliability of the data 
coll^^cted during this\period, trainees were required to conduct classroom observations 
under the supervision af-a^reliable observer. Observers were allowed to conduct 



obsery^ti<fcs alone only after tfe^Jhad demonstrated satisfactory reliability. EverjK^ 
trainee liiad repeatedly and satisfactorilj^emonstrated reliability T)y the end of 



the first week of actual observations. 
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Iristruroentatlon and Data Collection 

The^^iassrqom Observation Instrument was designed- to Include two tien-mlnute 
observation episodes during which the observer recorded detailed Informatloh about 
activities and materials used by the teacher and students working with the teacher. 
The pupils worHlng eith&r with an aide or on their own (e.g., self-r^hs true t ion 



activities not supervised by teacher) were not observed during the'^acher-focused 
observation. The observer recorded information, Including: the number of/pupils in 
the teacher's group, the nature and duration of the teacher activities , ;the nature 
and duration of the pupil activities, the type of materials used, and the frequency 
of approval and disapproval of pupil work or behavior. 

The two ten-minute obse/rvations were separated by a ten-miniite class observation 
during which the observer recorded less detailed information about activities and 
materials used in the class and pupil grouping patterns throughout the classroom. This 
information provided background and supplementary data and was not generally included,.JLr 
the analysis presented in this report. Therefore, the information obtained during 
the teacher-focused observation provides the bulk of the data presented for the classroc 
observation component. i ' 

Only 56 second and fourth grade ^classes from the 72 originally considered provide" 
the requisite complete data set (i.e., teacher and principal interviews, classroom' and 
individual observations, and ^test results for the tp.acher^s previous and present class). 



Each of these classes was observed for two ten-minute episodes during the reading 



instruction period on four 8et>arate days; therefore, providing a total of eight separate 
ten-minute classroom observation episodes. The data from these eight observation 
episodes were combined to c/lculate measure of central tendency (mean) and variation 
(standard deviation) for the class. 

The development of analysis variable based on the data fromf'the ClassV^om 
Observation Instrument is presented in this chapter. The results of descriptive analys: 
used to examine the types of resources and processes used for reading instruction ^s alj 



presented. In addition, th6 result of analysis of variance, conducted to detect differ- 
Q ences in resources and prot^esses across treatment groups and grad^ levels, is reported. 
^ ,0. li 



Classroom DemoRraphlcs / 
Class Size and Pupll'-Adult Ratio 

The average number of pupils present during the observation period was 17.8. The 
size of a class ranged from 5 to 32 pupils; however, approximately half the. classes 
consisted of 12Y24 pupils. The average number of pupils present during reading Instructlf 
was approximately the same for saturated and concentrated classes. ^ 

:One reason for the wide range In class size during reading instruction was the use 

of different scheduling procedures. Approximately one-third of the classes operated unde. 

t. ' ' 

a regular total cla;s schedule. The staggered schedule was adopted in the remaining two- 
thirds of the classes. TKe classes using this procedure divided the students into two 
groups base4 on reading aptitude or some other criterion. One group arriv ed at school, on 
hour early for reading instruction. This group left an hour earlier than the second ^ 
gi;oup, which had reading instruction at the end of the day* The staggered schedule was 
used equally by concentrated and saturated classes. This type of schedule significantly 
reduced class size during reiadlng instruction; however, it lengthened the teaching day. 
The classes using the staggered schedule succeeded in lowering the pupil- adult ratio 
during reading instruction. . \^ 

An additional method used to lower the pupllTadult ratio during reading instructl<|>: 
vas the use of instructional aides. Aides were present during A4% of the observations. 
Aides were fov^nd more often in saturated classes (53%) than in concentrated classes (36%) 
and considerably more often in total-class situations (73%) than in classes using the 
ftaggered schedule (28%). (Both the. treatment group and schedule differences are signifi- 
cant at p<.05, the significance level used in this study as the criterion for identifying 
reliable differences.) Therefore, aides were most often present in saturated total-class 
situations — classrooms in which larger numbers of pupils w^re present and aides were 
permitted to work with any pupil. Conversely, aides were, least likely to be found in 
classes In which the staggered schedule was used to reduce class size and the aide was 

( • z 

restricted to working with pupils classified as EDY. 



* 

Average size of the teacher *6 total class was about 28 for both the concentrated 
and saturated groups. ^ 
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The use of the staggered schedule an^ the use of aides enable the dlstf^lct to 
realize an average pupil -adult ratio of 13:J fof reading instruction in the classroom 
observed. However, because of the widespread use of aides in classes operating under 
the total-class schedule, pupil- adult ratio did not differ as widely between the 
staggered classes (average of 12:1) and total classes (average of 16^) as might have 
been expected,^ Reliab.le differences across treatment groups were not~'f ound,'* 
" l^upil Teacher Grouping Size 

Teachers worked with an average of about 10 pupils during a ten-minute episode. 
This represents slightly over half the pupils present. Group size did not differ 
significantly across treatment types or grade levels. 

Use of Instructional Resources Outside the Classroom ^ 

Under both treatment conditions. Instructional resource's were rarely used 
outside the classroom during reading instruction. One or more pupils were sent to 
a reading specialist or a resource center in only 7% of the observations. This 
finding, however, does not indicate that these resources have not been fully 
Utilized, primarily because federal regulations specify that resources purchased with 
Title I funds should be used to supplement rather than supplant basic instruction. 
Therefore, limited use of thse resources during the basic reading instruction period 
is in accord with these regulations. 

Classroom Composition 

Saturated and concentrated classes in the sample were^similar in composition. 

In both groups, approximately two-thirds of the pupils present during the observations 

were classified as EDY. The average ethnic composition inHoth groups was 58% SpanisW 

.-• . ■ ' i ■ 

surname, 23% Caucasian, 12% black and tL other.. The average age was 8 years 11 month 



for second-grade and 10 years A months for fourth grade. /In addition, both groups ' 
consisted of equal proportions of boys and girls. ^ / 



Descrip tive Results — Teacher-focused Observations 

Teacher Roles 1 

' '■ I 

The observer recorded the teacher's activities during the ten-minute teacher- 
focused observation using a role code. (See Appendix A.l for ^operational definitions.) 

! ~ "> 

The analysis variables developed from the teacher role code include |j'asure of role 
diversity (average number of different roles per episode), and role Cypes (instructional 

VS. noftlnstructlonal, directive ys, self-Instruction, interactive vs, f acllltatlveX. 

1. • " 

The observer could record up to six roles per observation episode; however, the 
average number observed was moderately low (2.26),* In only lOZ of the teacher-focused 
observations were more than three roles observed. The maximum number observed was five. 
Diversity of teacher roles did noX differ reliably across treatment group or grade 
levels. 

Virtually all of the 75 roles codified were observed in at least one observation 
episode; however, a relatively few roles accounted for the substantial percentage of 
all roles observed."*^ The most common teacher activities observed were oral or silent 
reading and reviewing (24%),** drill (23Z) , classroom management (15%) , and assigning 
tasks (9%). Together these four activities represented 71% of all teacher roles observed. 
These roles were predominant across treatment groups and grade levels. 



* 

Roles could be Interspersed, as in the case of a teacher who alternated between making 
asslgnxpents and drill activities. However, a given role code was recorded only once 
during an episode. The time recoi^ded for the role reflected total number of minutes 
across all occurrences of the role within the episode. 

"^'Frequency of occurrence for each of the 25 roles is shown in Appendix B.3. 

This group activity is actually a combination of three codes: oral/silent reading, 
reviewing, and oral/silent reading with/ review. The distinction between the first 
two codes and the third is essentially one of pacing. Observers used the third code 
when the teacher continually alternated between asking pupils to reid passages aloud 
or silently and asking questions about the passages. Vnxen either the reading or the 
questioning persisted for two minutes or longer, without interruption by the other, 
the component activity w^s coded. 
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Pupil Roles 

\ 

The roles in which the pupils were involved while working with the teachers vere 
also recorded* (See Appendix A. 2 for operational definition.) The observer could 
observe up to six different roles per episode » although the average number observed 
per episode was moderately low (2, 59). In only 20% of the groups c^served were more 
than three pupil roles recorded • The diversity of pupil roles did noT- differ, reliably 

^ i 

across^^ treatment groups or grade levels. 

As with the teacher roles, numerous pupil roles were observed with only a few 
predominating.'*' The pupils' predominating roles and the teachers* predominating roles 
were related to involvement by both pupil and,' teacher in the same activities; therefote^ 
\ many of the pupil roles were counterpart to the teacher roles. The most common activities 
^nvolving pupils working with the teacher were oral/silent reading and review (22%) and 
drill (20%). Receiving assignments and participation in classroom^ management activities 
represented 8% and 9% of all pupil roles» respectively. Two additional roles were 
fairly common among pupils; seatwork (completing assignments — 11%) and transition (waitln{ 
for a new task or the teacher's attention — 6%). Together these activities accounted for 
three-fourths of all the pupil roles observed. 

Teacher and Pupil Time Engaged in Instructional Activities 

In the previous two sections, the frequency of specific teacher and pupil roles 
was examined without regard to the amount of time spent in those roles. The observers 
did, however, record the number of minutes associated with each role. Two dimensions 



Multiple pupil roles were recorded when the whole teacher's group switched from one 
activity to another or when different members of the group were simultaneously 
engaged in different roles. ^ 

■r 

Relative frequencies of all pupil roles are shown in Appendix B.4. 



were developed hoth to examine any patterns associated with how the teachers and the 
pupils used their time during reading Instruction and to determine whether any relation- 
Ship existed between those patterns and test outcomes. The first dimeflkion, engaged tim 
was a measure Lf the proportion of time devoted to instruction andr|ctivlties directly 
related to\ instruction. The second dimension, instructional stj/Ie^ai a characterizatlc 
of the activity level or mode o-f instruction associated with each i.bleVobsferved. 
^ Engaglgd Time 

In orier to measure the proportion of time devotfd to' instruction and the assocl-. 
ation With the Instructor, all of the teacher and pupil rbles were classified as 



Instructional or nonlnstructlonal in nature.* Then the projiortion of teacher and pupil 



time associated with instructional roles was calculated for e^h observation episode. 
Complete data from all observations of a given class were combined to derive measures 
of average pupil and teacher engaged time. This measure wais found for all 56 classes 

The results presented in Table ^ indicate consistently high proportions of 
engaged time. Generally, pupils and teachers spent about 90% of their time in activitie 
of an Instructional nature. This indicates that out of the 80 minutes of total observa- 
tion time per classroom, an average of less than nine was devoted to classroom managemen 
discipline, and other activities not directly related to instruction. This pattern of 
high engaged time is consistent across treatment groups and grade levels. 

Table 1 ' v 

Teacher and Pupil Engaged Tim^ during TeacHer-Focused Observations 





Saturated 
Grade 2 Grade 4 


Concentrated 
Grade |2 Grade 4 


All 

Classes 


Engaged Time — Teachers 
Engaged Time — Pupils 


90.97% 
89.60 


87.31% 

87.99 

V- 


91.29% 
90.24 


83.42% 
87.97 - 


r 

88:«29% 

/ 'A ■ 

88.94 


(N\imber of Cases 


(15) 


(14) 


(13) 


(14) - 


(56) 



A breakdown of Instructional vs. nonlnstructlonal roles is shovm In Appendices A 1 
and A. 2. 



Instructional Sty le 

Activities levels or modes of instruction were developed to facilitate the 
examination of patterns of time utilization associated with each role observed. 
Teacher roles were grouped into five nonover lapping modes, each of which is described 
below* The specific roles included in each category, and their relB^Llve prominence 
within the category, are shown in Table 2. 

i Teacher directive roles * In these roles,, the teacher is the primary 

actor. Where pupils are involved, they are typically receiving directions 
or other information from the. teacher, with no immediate response or parti- 
cipation (other than listening) required on their part* Teachers observed 
in directive roles were most often performing classroom managenent tasks, 
making assignments, or instructing (lecturing)* Other activities included 
in this category but observed much less often are reading aloud, discipline, 
and praise. 

Teacher-initiated interactive roles *. In these roles, the teacher also acts - 
as instructional leader, but pupils are assumed to take a more active part. 
Basically these roles represent several variations oit^a q^>eytion-and-response 
format, with pupils making frequent group or individual responses in these 
interactive roles. Teachers were usually leading drill (for example, on word* 
attack skills or voca1),ulary) , leading group oral or silent reading and review, 
and administering tests. 

Discussion and social interaction with pupils . This category indexes a somewhat 
different type of teacher-pupil interaction. Discussion and social interaction 
involve more extended pupil talk, and pupils*/ comments are not generally re- 
stricted to reading aloud and answering spec/if ic quesitions from the teacher. 
The pupils interact with teacher on a much higher level of creative or inter preti\ 
thought than in interactive roles. 

Teacher assisting and monitoring pupi? work (facilitatlve) . In these roles, 
the teacher provides support and assistance to pupils who are engaged in 
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. relatively independent activities. The teacher is facilitating assigned 
seatwbrk (reading stories, using workbooks or dittos r etc.) or self-instruc- 
tional activities (instructional games, audiovisual equipment, or creative 



work) • 



Teacher idle . The teacher has been coded as doing nothin^ox a period of . 

at least one niniite. during the ten-minute observation episode. 
2 ^ 

t ^ Table .2 

^ Relative Contributions of Teacher Roles to Instructional Mode Scales 



Name of Teacher Mode 



Major Contributors 



Other Contributors 



Teacher directive roles 



Teacher-initiated 
interactive roles 



Discussion and social 
interaction with 

pup il ls 

Teacher assisting and 
monitoring pupil 
work 

Teacher idle 



Managing (51%) 
Assigning task (32%) 
Instructing (10%) 



Drilling (A2%) 
Oral/Silent reading and 

review (42%) 
Testing y assessing (12%) 

Discussion (66%) 

Social Interaction (34%) 



Facilitating pupil 

seatwork (85%) 
^Facilitate self-instruction 

activities (15%) 

Doin^ nothing (100%) 



Story telling, reading 

aloud (3%) 
Disciplining (2%) 
Reciting V'Oetry ) 
Interrupted by office) 
Praising ) 

Tutoring (5%) 



less 
than 
1% 



\ 



A profile reflecting the proportion of a given teacher's time in these five 
modes was generated by calculating the proportion of time In each>ode withih each 
observation episode then taking the average across all episodes for the teacher. Mean 
prftportions of time in these modes, fliveraged across all 56 teacher^, are displayed in 
Table J. The teacher-initiated interactive mode clearly dominates, accounting for an 
average of 70% of teacher time. The directive and facilitative modes together represent 
an average of 25% of teacher time. Discussion and social interaction are comparatively 
rare, accounting for an average of less than half a minute per episode. 



Table 3 

Average Proportion of Teacher Tim« In Five Activity Modes 
during Teacher-Focused Observations 



Activity Mode 


Proportion of Time In-Mode 
Mean' Standard Devlatibh' 


Directive 


IA.43% 


10.665r 


Teacner-lnltlated Interactive 


70.28 


21.235 


Discussion and social Interaction * 


3.25 


6.590 


Assisting and monitoring pupil work 


iO.63 


13.111 


Idle 


l.Al 


3.237 1 



Pupil roles were grouped Into four nonoverlapplng participation modes which 
generally correspond to the teacher modes. The roles in each mode, and t:helr relative 
prominence within the mode, are displayed In Table 4^ The four pupil inodes or 
levels of activity are: 



Pupils r eceiving directions . In these roles no Immediate verbal response 
or activity (other than listening) is required of pupils. These roles 
are most of ten observed in conjunction with teacher directive roles, as 
pupils listen to the taacher make an assignment, carry out classroom 
management tasks, or lecture. ^ 

Pupils responding to teacher . Pupils are involved in activities that 
are led by the teacher but that cAll for them to respond, either as 
Individuals or in a group. These roles are the pupil co\interparts to the 
teacher-initiated interactive roles—drill, oral/silent reading and 
review, and testi 

Pupils engaged in seatwork and self-instruction . These roles call - 
for the. most active level of participation from pupils. Most often 
pupils are working fairly independently, completing seatwork assignments 
or carrying out self-instructional activities (working wit£ audiovisual 
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equipment or instructional games, working on creative tasks. Less 
often pupils are involved in discussions or social interactions.* 



Pupils idle. Pupils have been Coded as in transition (waiting to 
begin a new task or to get the teacher»s attention) or as riot attendi 





one hinute • 






Table A * 


- m ■ 

» 


2 Relative Contributions 


of Pupil Roles to Instructional Mode Scales 


Name of Pupil Mode 


Maior Contributors 


Other Contrlljiitorc 


Pupils receivlnc 
directions 


Being managed (42%) 
Being assigned task (38%) 
Beine instructed 


Listening to story (5%) 
Being disciplined (3%) 
semg praiseo (less than IZ) 


Pupils responding to 
teacher 

• 


Oral/silent reading 

and review (45%) 
Drill (40%) 

Being tested^ assessed 

(11%) 


Be^ng tutored (5%) 

1 
1 

! 


rupiis engaged in seatwork 
and self-instruction 


Seatwork C6A%) 
Self instruction — AV 
games, creative work 

an) 


Discussion (13%) 
Social interaction f.3%) 
Clean-up )less 
Reciting poems )than 
Visit resource ctr ) 1% 


Pupils idle 


In transition (65%) 

Not attending to task (35%) 





A profile of pupil time in each mode was generated for each classroom using 

essentially the same procedure followed in generating the teacher profiles. Pro- 

I • • • ■ ■ 

portions of pupil time in the four modes is presented in Table 1, Pupils working 

with the teacher during reading instruction spend an average of 65% of their time in 
the responding mode. 



Discussion and social interaction were included in this category rSther than treated 
separately because, like seatwork and self-instruction, they were assumed to involve 
highly active participation of pupils. For teachers, discussion and social interaction 
were treated separately in order to examine differences in instructioaal style. These 
two roles were rare for both teachers and pupils. 



Table 5 

Average Proportion of Pupil TIjiic in Four Activity Modes 
during Teacher-Focused Observations 



Proportion of Time irirMode 
Activity Mode Mean 



Pupils receiving directions 




9.02% 


18.2^ 


Pupils responding to teacher 




65.10 


m 

20.128 


Pupils engaged in seatwork and 
self-instruction 


.1. 


20.35 


7.202 


Pupils idle 




5.52 


5.764 



Most of their remaining time Is spent completing seatwork assignments or working on 

self-instructional activities. On the average, comparatively little pupil time is 

spent receiving directions. The low proportion of idle time among pupils may be due 

in part to the observers' focus on only those pupils who were working with the teacher.*. 

The relative proportions of a given teacher ^s time in the five teacher activity 

modes were used as a profile of that teacher's instructional style. The pattern of pupil 

time use within the teacher's classroom has been treated as a second profile, reflecting 

how pupils in the classroom experience reading instruction. A comparison of the teacher 

and pupil profiles shows strong sAmilarities In the relative proportion of time spent in 

corresponding teacher-pupil modek. The correlation between use of pupils and teachers /' 

time (presented in Table 6l) Indicates these strong similarities. Correlations between 

the^ time the teacher spent liy^ the directive, interactive, and facUitatrve modes and the 

time the pupils spent in th/ counterparts of those modes (i.e., receiving directions, 

responding to teacher, arvdf seatwork/self-lnstruction, respectively) are high and positive*' 
Correlations for time s^nt in noncorresponding modes are generally negative. 



* y ^ 

In. another section of the instrument, observers recorded information about grouping * 
patterns and pupil activities for the classroom as a whole. Data from these observations 
showed a higher frequency of down time among pupils not working with the teacher or an ali 

Perferct correlations would be obtainfid only If all pupils In the teacher's group were 
engaged In a single type of activity^ cor responding to the teacher's activity, and 
^pupils were never Idle unless the' teacher was also Idle. ^ 

•» 7 
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Correlatl^ons between Proportions of Teacher and Pupil Time 
Corresponding and Noncorresponding Modes 

during Teacher-focused Observations -.• 



Teacher Mode 



Pupil Mode 



Dlrec 



Idle 



ReceivjLng directions 
Responding to teacher ^ 
Seatvork, self-instruction 
Idle 




Profiles of teacher and pupil time use by treatment group and grade level are 
displayed in Table Z. Reliable differences, across treatment groups are found in both 
the teacher and pupil profiles. 

Teachers in the saturated classes spent 70% of the time in the interactive mode* 
Correspondingly, the pupils in those classes spent 72% of the time in the interactive 
mode. The teachers in the concentrated classes, although spending a majority of the time 
in the interactive mode, u^ed seatwork and self-instruction activities for their pupils 
significantly more often than the teachers in the saturated. classes. Consequently, the,^^ 
teachers in the concentrated classes spent more time monitoring or assisting their pupils 
in these act|V:^ties than the teachers in the saturated classes* Pupils in the Concentrate 
classes spent an average of 28% of the time in seatwork and self-instruction. This 

o 

represents almost twice the amount spent by pupils in^thc saturated classes. 
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' Table 7 

Average Proportions of Teacher and Pupil Time in Instructional Modes 
^during Teacher-Focused Observations by Treatment Group and Grade 



Instructional Mod e 



Average Proportion of Tlnie In Mode 
Saturated Concentrated 



Ft 



Tmt. Group 
Difference 



Grade 2 


Grade 4 


Grade 2 


Grade 4 


P <.05 


12.282 


'14.27Z 


15.002 


16.00% 




78.26 . 


77.06 


69.04 


56.15 


X 


1.63 


3.07 


3.83 


4.46 




7.28 


. 4.28 


12.13 


19.37 


X 


0.54 


1.32 


0.00 


3.91 





/ 



Teachers 
Directive 
Interactive 

Disc. & soc. interaction 
Assisting & monitoring 
Idle 



7 



Pupils 












Receiving directions 


6.88 


7.99 


12^33 


9.25 




Responding to teacher 


74.23 


69.58 


66.64 ' 


49.41 


X 


Seatwork & self-instruct. 


12.40 


15.69 


17.65 


36.02 


X 


Idle 


6.52 


6.64 


3.38 


. 5.33 




(Number of Cases) 


(15) 


(14) ' 


(13) 


(14) . ■ 





Likewise, teachers in concentrated classes spend a significantly greater amount of time 
(16%) facilitating these activities than do teachers in saturated classes (6%) . 

Exainination of grade-level differences within treatment group reveals an addi- ^ 
tional pattern. In saturated classes » ,the profiles are' very similar in both grades/ 
However, the concentrated classes* profiles apparently differed froxl^jpecond to fourth 
grade. Specifically, the .diversity of teacher and pupil act](^tles^ncreases from second 
to fourth grade. Fourth-grade pupils in concentrated classes s^enamore than a third 
of their time in seatwork and self-instruction — twice as much' time as the second graders* 
Likewise, -^fourth-grade teachers in concentrated classes spend more of their time assisting 
pup'ils than any other group of teachers. 
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The data in Table 7^ indicates that the teachers in saturated classes relied 

^ t • . ' ^ '■' ■ ■ 

almost exclusively on the interactive mode T^e instructional style of the teachers 

* 

in the concentrated classes is more diverse, thereby allowing pupils to experience a 

wider range of activities in teacher-led reading group|u This diversity is more pro- 

flounced In the fourth grade. One possible explanation is tha^ teachjrs^ in concentrated 

classed use, various modes of instruction as a technique for concentrating a^rvitcs on 

EDY pupils. Unfortunately, data frdm 'the Individual observation instrument (which will 

be discussed in a subsequent section) do not show systematic differences in use of time. 

* 

by EDY and nonEDY pupils in the concentrated classes. 

The use of aides in the cclassroora contributed to the differences between the 
treatment, group's instructional- profiles. Aides were used more frequently in the 
saturated clrsses. Data from the whole-class Indicated that aides frequently assisted 
and monitored pupils in seatwork and self-instruction activities (the whole-class 
observation was made during ten-minute break between the two teacher-focused observations 
When an aide was available, pupils using audiovisual equipment and games or completing 
their assigned seatwork apparently worked unsupervised or with the aide, rather than witl 
the teacher. Consequently, seatwork and self-instruction were rarely observed in the 
teacher-focused observations when an aide was present. In classrooms without aides, 
these activities were generally pursued within the context of the .teacher's group, and 
therefore were more likely to be included in the teacher-focused observations. 

Data from the individual observations, which were not limited to pupils 
working with the teacher showed that pupils in saturatesd classes spent more time in 
seatwork and self-instruction than was Indicated by the teacher-focused observations. 



The individual data do not indicate that concentrated teachers vary instructional modes 



in the same way for all pupils, ^nly that variations in mode are not reliably associated 
with the child's EDY status. 



However^ the data from the individual observation instrument reaffirmed that pupils in 
the concentrated clases spent significantly more time involved in seatwork and self- 
instruction than the pupils in the saturated classes. Therefore > using more aides in 
saturated classes apparently accounts for only part of the observed differences in 
instructional style across treatment groups. 



Instructional Ma terials , 

The observers also recorded Information concerning the types and diversity of 
instructional materials used /during the teacher-focused observations. The primary 
materials used were textbooks (used during about half the teacher observations) and 
workbooks (about 38% of the observations) . Other materials include blackboard or 
magic slate (21%), paper and pencil (16%), flashcards or teacher-made materials (13%), 
and^ittos (11%). ' 

The average number of different materials used during a ten-minute episode 
was 2.00. An average of 2.20 materials per episode were used in the concentrated 
classes, which is^ significantly higher than the average of 1.86 materials used in the 
saturated classes (p<*05). In addition, teachers in concentrated classes were more 
likely to use materials purchased with EDY funds. Approximately A3% of the materials 
used in concentrated classes were purchased with EDY funds. Teachers in saturated 
classes used approximately 27% EDY materials (pC05). Although no reliable differences 
in overall materials usage were found across grade levels, fourth-grade teachers in 
l^oth treatment groups made proportionately greater use of EDY materials than second- 
grade teachers. 
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Teachers* Interpersonal Style 

The teachers' interpersonal style was also observed during the teacI;ier-focused 
observations. Observers recorded both the frequency and the intensity of the following 
teacher behaviors: 
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Supportive verbal expression — comments from the teacher praising 
*.^vi?upll work or behavior. 

Supportive nonverbal expressions -actions by the teacher indicating 
approval of pupil work or behavior » ranging from smiling or putting 
stars on pupils^ work to putting an arm around a pupil* 

Nonsupportlve verbal expression — comments from the teachef^ criticizing 
■ * > 

_ ' or showing disapproval of pupil work or behavior. 

> Nonsupportlve nonverbal expression — actions by the teacher indicating 
disapproval dr criticism of pupil work or behavior » such as frowning » 
distributing markers of poor performance » or making a list of 
disruptive pupils. 

Behavioral data for each of the 56 teachers were combined apross observations 
to form several Indices of the teacher's Interpersonal style ^br responsiveness. The 
measures are described in Table which also shows the mean score across all 56 
teachers for each scale. Fundamentally » scales were developed on three levels. On the 



first level, scores on verbal and nonverbal responses were combined, retaining both the 



distinctions between frequency and intensity of these responses and the dlstrlnctlon 

L 

between supportive and nonsupportlve teacher behaviors. On the second level, frequency 
and intensity were combined to generate separate measures of supportive and nonsupportlve 
affect. On the third level, the supportive and nonsupportlve scales were combined to 
provide an overall index of the teacher's responsiveness or Interpersonal style. 

The mean scores presented in Table 8_ suggest two general findings: First, 
even though |rirtually all teachers displayed some supportive affect, the display was 
telatlvely Infrequent and at a low level of intensity. The majority of teachers took 
care to praise the students only when appropriate. Second, the vast majority of teachers 
rarely commented or acted in a manner which indicated disapproval of pupils' work or 

I 



Statement such as "Yes, that's right" or "No, that's wrong" were regarded as neutral 
feedback and were not counted as instances of supportive or nonsupportlve verbal 
expression. Only comments that Included praise or criticism were counted. 
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Table 8 

Teachers' Interpersonal Style Variables Created from Data Collected 
during Teacher'-Focused Observations 



Interpersonal Style 
Variables 



Contents of Variables 



5core 
iLange 



Mean 

Score 

(n=»56) 



First-level variables 



Second-level variables 
Supportive affect 

Nonsupportive^ affect 

Third-level variable 
Teacher responsiveness 



Freq of supp X intensity 
of supp 

Freq of nonsupp X inten- 
sity of nonsupp 



Supportive affect X 
nonsupportive affect 



4-64 



Freguency of supportive ^ 
responses - 


-Frequency of supportive 
verbal + nonverbal 

.1. 


2- 


-8 


3.95 


Intensity of supportive 
responses 


Intensity of supportive 
verbal + nonverbal 


2- 


-8 


3,80 


Frequency of nonsupportive 
responses 


Frequency of nonsupportive 
verbal + nonverbal 


2- 


-8 


2.13 


Intensity of nonsupportive 
responses 


Intensity of nonsupportive 
verbal + nonverbal 


2- 


-8 


2.15 



18.65 
4.83 



16-A096 88.21 



behavior. No criticism or disapproval ^as observed during any of the, eight ten-minute 

\ , \ 

episodes for 52% of the teachers. Only 11% of the teachers averaged indre than one 

instance of criticism or disapproval per episode. | 

Correlative analysis of the affect variables revealed additional general 

findings regarding teachers* interpersonal style: Teacher praise andjapprovai are 

not related to criticism and disapproval (at least for this group of jbeachers). / 

Essentially, teachers who score relatively high on the positive measures are neithe^ 

more nor less likely than other teachers in the sample to score high: on the negative 

(nonsupportive) measures. Supportive and nonsupportive responsiveness apparently 

' i ' - ■' \ 

function as relatively Independent components of these teachers' Interpersonal styles. 
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Mean scores on the responsiveness scales ore displayed by grade level within 
treatment group In Tabic 9. Teachers In concentrated classes made more frequent support 
ive affect than teachers In saturated classes. (Only the intensity measure reaches the 
criterion significance level of .05 for treatment group differences; however, difference 
between teachers in saturated classes and teachers in concentrated ^classes on both the 
frequency scale and the overall measure of supportive affect are iff^^he same direction 
and aipproach the criterion significance level.) Reliable differences across treatment 
groups were not found for the nonsupportlye scales or for the overair responsiveness ind 

Table 9 

Teachers* Interpersonal Sty 1<^ by Treatment Group and Grade Level 



■ 




Average Score 


on Variable 




Tmt Group 
Difference 




Saturated 


Concentrated 


Slgnlf at 
P<.05 


Variable 


Grade 


2 Grade A 


Grade 2 


Grade A 


Frequency of Supportive 
responses 


3.56 


2.92 


A. 12 


3.AA 




Intensity of supportive 
responses . 


3.51 


2.86 


A. OA 


3.A6 


X 


Frequency of nonsupportlve 
responses 


2.AA 


2.23 


2.35 


2.20 




Intensity of nonsupportlve 
responses 


2. 49 


2.25 


2.A7 


2.27 




Supportive affect 


15.03 


9. AO 


19.26 


13.93 




■.<cnsiipportlve affect - _ r 


7. OA 


5.75 


6,.A2 


5.35 




Teacher responsiveness 


116.05 


A7.A1 


121.98 


78.97 




(Number of cases) <^,; 


(15) 


(lA) 


(13) 


(lA) 


<? 



In both treatme;nJ^" igroups,^ the second-grade teachers consistently received higher 
scores than the fourth grade teachers on the supportive and nonsupportlve measures. Thl: 
indie ates that the second grade teachers used immediate praise or disapproval more fre^ 
quently than the fourth grade teachers (disapproval was relatively rare response towards 
pupils). Therefore, with the sample of second and fourth grade teachers, the inter- 
personal style was found to be related more to grade than to treatment group, with 
teachers responding more frequently to second grade pupils. 



Individual Pupil Observations 

The Individual Student Instrument vas designed to focus on specific students, 
selected In advance, to obtain information about their activities, use of materials 
and shifts in group involvement during the entire reading period. The observer 
focused on individual students who were pre-selected according to giade level, EDY 
status and the type of class treatment in which the students were involved, • Each of 

four students per classroom w^s observed for approximately 30 minutes, 

I. • " 

The individual pupil observations were designed to obtain information describing 
instructional resources and processes used by teachers in the two treatment conditions. 
Unlike the teacher-focused observations, the focus on individual pupils provided 
additional information about the Implementation of the saturated or concentrated 
treatment - i.e., how teachers differentiate resources and processes used on the basis 
of pupil EDY status. The additional information was used to address the basic issue 
of whether teachers used different materials and/or methods with EDY student than 
those used with nonEDY students, and if so, under what treatment conditions did such 
differentiation occur«r The use of different methods and materials for EDY and nonEDY 
is assumed to be consistent with implementation of the concentrated treatment, 
providing that the use reflects the focusing of EDY resources and services on EDY 
pupils. In saturated classes, however, differences between EDY and nonEDY would not 
necessarily be expected. 



The Individual Instrument was structured around Instructional activities In 
which the target pupil was engaged over the observation period* An activity Is 
defined as Including four elements: 

Pupil role . The nature of the task in which the child is- engaged 
(e.g., drill, oral/silent readinjj, receiving assignment)^ 

. 

Materials usage . The type(s) of material with which the child is 
i working (e.g., textbook, workbook, blackboard, dittos); the source 
of funds used to purchase '•each material being used (EDY, other, 
combination of EDY and other funds) . 

Group leadership . The instructional leader (s) of the group in 
which the child is working (teacher, aide, other adult, cross-age 
tutor); activities not led by an adult or cross-age tutor are 
defined as self-directed. 

Group size . The total number of pupils in the group of which the 
target child ts a member.^ 

Whenever one or more of these elements changed, the current activity was considered 
complete and a new activity (combination of pupil role, materials, group leadership, 
and group size) was recorded. Observers also recorded the number of minutes associ- 
ated with each activity in which target children were engaged. 



*The pupil role codes developed for the Classroom Observation Instrument were also 
used in the individual observations* 

'*'a group is defined as two or more pupils working with 'the same group leader and/or 
involved In the same activity (y±th or id^thout a leader) and arranged in close 
physical proximity to each other. Pupils working on a common task but not seated 
together were considered to constitute a group only if a teacher or other leader 
identified them as such. 



A two-stage sarapling pr|>cedure was used to^Wect pupils for individual observa- 
tions on the basis of three sampling variables: treatment condition (first stage), 
grade level^first stage) and EDY claissification (second stage). The two first-stage 
variables were deterrnit^ at the classroom level; that is, four pupils were selected 
from each of the 72 classrooms representing the four treatment group/grade level 
permutations. Within each cla^siroom, individual pupils were chosexv on the basis of 

* 

theii^ EDY classification. Whenever possible, EDY pupils vere selected from the lowest 

», • ■ ■ • , ■ 

quartile (first to twenty-fifth percentile) and nonEDY pupils from the highest quartile 
(seventy-sixth to ninety-ninth percentile). This procedure facilitated the determinatioi 
of whether instructional patterns (resource utilization, mode of instruction, etc.) 
differed for EDY and nonEDY children in either treatment condition. The-as^mption 
was made that whatever distinctions a teacher made between EOT and nonEDY pupils would 
be most apparent by focusing on the individual observations on very low-scoring EDY 
pupils and comparatively high-scoring nonEDY pupils. 

The three- s'aunpling variables constitute an eight-cell matrix (see Figure i), 
with 36 children in each cell. Within each cell children were selected to reflect as 
closely as possible the ethnic composition of the overall 72- classroom population 
(approximately 58% Spanish surname, 23Z Caucasian, 12% black and 7% other) and to 
Include equal numbers of boys and girls. 
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TREATMENT CONDITIONS 



GRADE 2 



GRADE 4 



Concentrated 


Saturated 


EDY (36) 


EDY (36 


nonEDY (36) 


nonEDY (36) 


EDY j(-36) 


EiDY (36 


nonODY (36) 


nonEDY (36) 



Figure 1 

Target Sample for the Individual Pupil Cfcservations 



m 

EDY status was determined by Total Reading score obtained on the MAT administered 
in Fall 1977. Children scoring the 50th percentile (according to the national norms 
developed by the publisher) were 
percentile were classified as nonEDY. 



ERIC 



30. 



3 i 



The results reported here are based oji the 219 pupils with Individual 
observation data and pre- and post-scores on the MAT. These 219 children constitute 
the analysis file for the Integrated analyses of pupil-level data reported in the 

analysis section. Demographic characteristics of the 219^ pupils are displayed In 
Tables- 10 aiid !!• Hi 

~. ■ *» 

u Table 10 

Demographic Characteristics of Pupils in the Individual Pupil File: 

Second Grade Subset (N=118) 



Spanish surname 

Caucasian 

Black 

Other 



Concentrated (63) 



EDY (32) 
21 
7 
3 
1 



nonEDY (31) 
17 
9 
1 
4 



Saturated (55) 



EDY (32) nonEDY (23) 



ii 

6 

5 



31 
8 
2 



Table 11 

Demographic Characteristics of Pupils in the Individual Pupil Filie; 

Fourth Grade Subset (N=101) 





Concentrated (51) 




Saturated (50) 


EDY (29) 


nonEDY (22) 


EDY 


(25) 


nonEDY (2A) 


Spanish surname 


16 


10 


15 




14 


Caucasian 


7 


7 


4 




8 


Black 


3 


3 


4 




2 


Other 


1 


2 


2 







/ 

/ 

/ 



/ 
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Individual Pupil Observations~Descrlptlve Results 
EngaRed Time 

A measure of engaged time was generated £6r each of the 219 pupils by 
calculating the total number of mli\utcs the child spent In all roles classified 

ae instructional (see Appendix A.2>. The results, displayed in TabJ^ 12.^ 

r f 

are very similar to those obtained from the analysis of the teacher-focused, 
observations. Specifically, second-- and fourth-grade pupils spent an 

average of 87% and 90Z of their time, respectively, engaged in activities directly 

/ 

related to instruction. Reliable differenced between treatment groups were 
not found at either grade level. EDY and nonEDY students in both saturated and 
concentrated classes generally had a high proportion of engaged time. In only one 
EDY-nonEDY comparison is there a significant difference in engaged tim6. In the 
fourth*grade concentrated classes, EDY pupils spent an average of 95% of their 
time in instructional roles, while the ^onEDY pupils spent an average of 85% of 
theirs in instructional roles. This difference (largely due to the differences 
between these two groups in average p^roportion of idle time) accounts for about 
three ii^inutes during the half-hour observation period. The average engaged time 
did not fall below 25 out of the 30 minutes for any of the groups. 



Table 12 

/ 

Pupil Engagctd Time during Individual Pupil Observations 











Average Proportion of EngaRed Time 








Coilccntratcd 


Saturated 


All 


All 


All 






EDY 


nonEDY 


EDY nonEDY 


Concentrated 


Saturated 


Pupils 


Grade 


2 


85.2% 


89.7% 


89.1% 83.7% 


87.5% - 


86.8% 


87.2% 


Grade 


4 


95.2 


85.7 


90.2 88.9 


91.2 


89.2 


90.2 
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Instructional Modes 

To examine relationships between EDY status and instructional processes, 
pupil roles were grouped into the four previously discussed activity modes (receiving 
directions, respo|nding to teacher or other group leader, seatwork and self- 
instruction, and idle — see Table above). The average proportions of time spent 
in these modes by second and fourth grade pupils are displayed In T^fele 13 and 
Table 14* Generally, the results .are sluiil^ar to the results obtained from the 
teacher-focused observations, with tfhe exception that time spent in seatwork and 
self -instructional activities is proportionately higher in the individual data. 

Second grade teachers in the concentrated classes apparently made some 

distinctions between EDY and nonEDY pupils. EDY pupils spend somewhat more time 

thas^onEDY in the responding mode (drill, oral/silent reading, etc.). /Moreover, 

nonEDY children spend more time receiving directions (e.g., being given assignments) 

and completing seatwork and self-instruction tasks. Within the saturated classes, 

the majority of time was fairly evenly divided between the responding mode and the 

seatwork/self- instruction mode lor both EDY and nonEDY pupils. . 

The results from the fourth grade differ. Fourth grade teachers from neither 

A. 

treatment groups made systematically different use of the three Instructional modes 
for EDY and nonEDY. Within the fourth grade, patterns were very similar within 
treatment type but very different between treatment type. Specifically, pupils in 
concentrated classes spent an average of half their time in seatwork and self- 
itnstruction (the responding (Interacting) mode no longer dominates) . However, in 
saturated classes, the teachers generally use the Interactive mode for EDY dnd • 
nonEDY children alike. . ' . 
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Table 13 

Average Proportion of Pupil Time In Four Activity Modes 
during Individual Pupil Observations: 

Second Grade (M«118) 



Tmt. Grp 
Diff. 





Concentrated 


Saturated 


All 


All 


All- 


Slgnlf. 




EDY 


nonEDY 


EDY 


nonEDY 


Cone. 


Sat. 


Pupils 


(P<.05) 


Receiving directions 


• 

5.6% 


5:0% 


"5.9% 


3.9Z 


5.5% 


5.0% 


5.2% 


X 


Responding 


52.6 


A3. A 


A5.6 


39. A 


A7.9 


A3.0 


A5.7 




Seatvork/self-lnstruct. 


29.1 


36.3 


A2.A 


A2.1 


32.8 


A2.3 


37.1 




Idle 


12.1 


8.2 


7.7 


1A.2 


10. A 


10. A 


10. A 





Table lA 

Average Proportion of Pupil Time in Four Activity Modes 
during Individual Pupil Observations: 
Fourth Grade (K«101) 



Average Proportion of Time in Mode 



Tmt. Grp 
Diff. 





Concentrated 


Saturated 


All 


All 


All 


Slgnif. 




EDY 


nonEDY 


EDY 


nonEDY 


Cone. 


Sat. 


Pupils 




Receiving directions 


5.8% 


5.0% 


5.9% 


3.9% 


5.5% 


5.0% 


5.2% 




Responding ' 


3A.3 


35.5 


62.2 


61.0 


3A.8 


60. A 


A7.A 


X 


Seatwork/self-lnstruct . 


57. A 


A8.7 


2A.A 


26.0 


53.8 


26.1 


AO. 2 


X 


Idle 


2. A 


10.8 


7. A 


9.0 


5.9 


8.5 


7.2 





In the concentrated classes, results from the individual students observations 
are siviilar to the findings from the teacher-focused observations. Within the second 
grade classes, teacher- (or other group leader) initiated interactions represented the 
primary instructional mode, particularly for EDY pupils; however, teachers frequently 
used independent seatwork activities sis a secondary instructional a^e, esiiecially 
for nonEDY pupils. Within the fourth grade classes, pupils did more, althopgh the 
interactive question-response mod'e still accounts for about a third of ED'Jr and nonEDY 
pupils* time« 

The pattern of time use for fourth grade pupils in saturated classes is 
consistent with findings from the teacher-focused observations. Group interaction with 
the teacher or other leade»- dominated pupils were involved in sfeatwork about 25% of 
the time — half as much as in concentrated fourth-grade classrooms. Findings from the 
second-grade saturated group observations are less consistent with the teacher-focused 
observations. Seatwork and self-instruction, which accounted for comparatively little 
time in the teacher-focused observations conducted In second grade saturated classes, 
are relatively prominent in the individual data. This is probably because second grade 
teachers in the saturated classes generally used seatwork and self-instruction for ^ 
pupils outside the group with which the teachdr was working. / 

< 

^ Instructional Materials 

Patterns of materials usage recorded during the individual observations are 
similar to the patterns found in the teacher-focused data. Pupils used textbooks 
and workbooks most often; however, pupils commonly used paper and pencil, dittos, 
and blackboard. 

Diverse use of materials apparently does not differ as a function of grade 
level, treatment condition, or EDY classification. However, fourth grade pupils in 
concentrated classes used EDY materials more often than fourth grade pupils in the 
saturated classes. EDY materials vere directed mainly to EdV pupils in these fourth 
grade concentrated classes (see Table 15;). Proportional use of EDY materials was \ ^ 
rn?r « least two tim^s greater among EDY pupils' in concentrated classes than amojig any other 
™" 35. ^JX ^ 



group of fourth graders. Fourth grade E*>Y pupils used EDY materials proportionally 
greater than any group of second graders. This finding is consistent with 
implementation of the concentrated treatment. 




Table 15 



vProportion of EDY materials Used during Individual Pupil C^servat3,ons 



Grade 2 
Grade 4 



Average Proportion of EDY Materials ijsed 



Concentrated 
EDY nonEDY 



23.5% 29.5% 
A8.9 25.2 



Saturated 
EDY nonEDY 



All 



AIL 



Cone. Sai/T 



15.0% 29.7% 
15.0 i2,A 



All 
Pupils 



26,5% 21^2^^ 2A,0Z 

38.7 18^7 28,7 

\ 



Tmt Grp 
Dif ferctic 
Signify 
(p<.05) 



Croup Size ' ^ <a, 

Average group size was abotlt 10 in botK the second and fourth-grade classes* 
Group size did not differ relifltbly between treatment groups in either grade. In 
the concentrated classes » groupings do ivot appear to differ between EDY and nonEDY 
pupils*- It/ saturated second-grade classes, however/ nonEDY -^pupils generally worked 
in smaller gfoups than EDY pupils. This distinction was not found in the 
fourth grade saturated classes. . V ^ 

Table 16 



Average Size of Instructional Groups during Individual Pupil Observations 







: 

Average 


Size of 


Instructional Group 






Trot Grp 






1 Concentrated 


y 

Saturated 


All 


All 


All 


difference 
Signif . 
(p<.05) . 






1 EDY nonEDY 


EDY 


i^onEDY 


Cone . 


Sat. 


Pupils 


Grade 


2 


10t.A, 11. A 


11.0 


8.0 


10.9 


. 9.7 


10.3 




Grade 


4 


9.7 11.1 


9«3 


10.3 


10.3 


10.0 


10.1 





Two basic questions guided the analysis of study data for evidence of treatment 
effects: 

Xl) Does saturation or concentration of compensatory resources and 
services — to the extent such occurred In this study — relate to 
'reliable an^^jpeanlngful differences In basic reading skill 
attainment? H 

: JC2) What are the contextual and procedural (InstriAtlonal) conditions 
which account for differences In reading sklj.1 attainment? 

^e first question focuses on the, effectiveness of the implementation of the two 
treatments. Given the administrative , logistic. and financial/aspects of saturation vs. 
concentration of treatment » the essential objective was to determine which method 
(treatment) of' dispensing compensatory educational resources and services should be 
utilized to attain highest pupil reading aptitude. An a^ddltional objective was to 
determine the central and peripheral effects of the allocations of these treatments on 
both cl'kss practi99s and pupil learning (reading, as measured by MAT). Throughout the 
analysis, an awareness of additional Issues was essential to determine whether they 
should be included in this study or further studies. 

The second analysis question focuses onothe more general domain of instructional 
effects. The primary objective here was to determine, from^evidence gathered in this 
stittiy, "^whdx^ of pupils, resources, and instructional proceudres 

taken together, accounted for learning outcomes (i.e., reading skills, as measured 
by the MAT), this "input-process-outcome" analysis represents an empirical extension 
of the emerging teacher effectiveness research and provides a basis for policy alter- 
natives to the saturation-concentration intervention being investigated* In other 
words, how do these findings compare with those from other major studies of teacher 



effectiveness (e.g., the Beginning Teacher Effects Study), and how these findings might 
include alternative interventions for Improvement of reading skills? 

The remainder of this section is divided into four parts* Part I contains a 
discission about the development of analysis variables. - Part II contains an examination 
of the data for evidence of effects due to saturation or Concentration, using data 



collected at tl^ class-level. Results of these analyses are reported separately for 
the second and fourth grades. Part III contains an extension of the analysis to 
Include Information on the relative effects of the two alternative modes of delivering 
compensatory resources and services at the Individual pupil level , -using evidence 
gathered from the sample of 219 children. This provides an examin^ion of pre-post 
testrjatterns in terms of degree of educational disadvantage, ethnicity ^gender, .and 
the interactions of these con^ditions with the alternative "treatments" as implemented 
by the teachers. Finally, Part IV deals with the more general question of how this 
• information regarding conter^ctual and instructional processes used in the class explain 
outcomes observed at the class level. 

. V - ( 
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I, — Development of Analysis Variables / 
These analyses have not been carried out as a set of hypothesis-testing 
activities. Although statistical tests of probability were used In the effects of 
saturation vs. concentration, greater emphasis was placed on Identifying and better 
understanding the proximal (near) and distal (far) consequences of} this attempted 
intervention. Additional emphasis was placed on evaluating such ^fects against 
, alternative InputTprocess-outcome patterns detected in the data. Variables designed 
to accomplish these analyses >wcre derive^, from both consideration of the fundamental 
issues in the demonstration project (i.e., saturation vs. concentration of resources 
and services) and from an awareness of the results of contemporary teacher effectiveness 
research. Therefore, two criteria were employed in defining and developing variables 
for formal analysis of the data: 

(1) A logical or manifest relationship to the demonstration project's 
goals and objectives (referred to as "implementation" variables); 

' and /or 

(2) A logical or manifes't relationship to constructs identified as 
Important in contemporary teacher effectiveness research. 

Variables developed from either criteria can be analyzed as input, process, or 

outcome indicators. Conseijuently , a measure of group size (pupil-teacher ratio) 

could be used as either an outcome indicator in aii analysis of treatment implementation, 

or an input or process measure in an analysis of determinants of variation in reading 

5cores. 

A brle^ summary of the variables or constructs developed for data analysis, 

•> 

including the source, operational definition, and descriptive statistics, is 
presented in Appendix B. ^ 

Moreover, the analysis of each data source was performed both Independent of 
and concurrent with all other data sources in attempting to Identify the optimal 
reduced set of variables for formal st-|tlstlcal treatment. The final set of analysis 
variables and their descriptive parameters are summarized in Appendix B. Since 



these are data sets foi^ Integrated analyses (at the teacher anil pupil levels 
respectively), the requirement that each case be b^ed on complete data from all 
sources resulted in a reduction of approximatel/20Z in the. overall data base, 
(i.e., from 72 to 56 teachers, and from 2AA to 219 pupils) . = 

Since measurement are aggregated over multiple observatioi^ (usually eight 
ten-Biihute observation /episodes for teacher/class variables, land up. to 16 ••roles" 
for individual pupil .,^tservatipns); both the mean (<:entral tendency) and standard ^ 
deviation (variability) for each variable are employed in subsequent analyses. 
This provides a^'asis for indirectly assessing the relative importance of stability 
and variability of process variables in accounting for outcdme variance'. For example, 
"individualization" as an instructional technique would imply higher standard 
deviations on process measures over the eight observations than would "routinizatlon" 
as a technique. Although the converse of the previous statement is not logically 
sufficient (i.e., high standard deviations on process measures do not themselves 
provide a sufficient condition to conclude that a teacher is "individualizing") , 
the inclusion of both moments (means and standard deviations) is useful in developing 
a better understanding of complex Instructional processes and their relationships 
to criterion patterns. 



11^ ^alysce of the Effects at tho Teacher/Class Level 



The Infomatlon obtained either during the classroom observations » through 
Interviews -and test data» or through additional methods vas scrutinized to determine ^ 
whether complete data on all relevant measures were available for each class. The 
requisite complete data set was found for^ 56 of the teacher/class btilts observed. 
The teacher/class unit was the elementary unit of analysis; therefoje, any* data not 
specifically measured oh the^level of the teacher/class unit was aggregated into the 
data base for the teacher /class unit as follows: 

(1) Teacher interview variables remained unmodified. 

(2) Role descriptors gathered for individual observation procedures 
were aggregated to the classroom level, and appropriate statistics 
(mean and standard deviation) were computed. 

. (3) Means and standard deviations were computed across successive 
observation episodes for each candidate variable. 

(4) Principal interview variables were imputed to teachers within 
their respective schools. 

j(5) Average classroom compositional and performance (MAT score) 
indicatory vei^ calculated for current year and prior year 
classes for teacher."^ 

The resultant data |set» showing mean values (and standard deviations, where relevant) 

on each of the final analysis variables, is presented in Appendix B.l. (See 

Appendix C for Intercorrelatlons among these variables. 



Relevant measures are defined as those showing a both substantial (p<.2) and a non- 
overlapping relationship either to the treatment variable; therefore, approximating' 
ond implementation variable and/or to the outcome measures. 

The alternative procedure of combining prior year scores of current pupils was rejecte<? 
because of a variety of technical and analytic considerations,- such as pupil mobility 
and attrition (ranging from 20-85%), different pretest form, nonheterogeneous prior clt 
assignments and prior research on the stability of teacher effects. Moreover, the 
procedure adopted for this analysis better assures identification of instructional trai 
among "truly" effective teachers (i.e., those who consistently produce high-scoring pup 
rather than focusing on Instructional effects at Individual pupil level* The latter is 
is addressed by the individual pupil analysis, the results of which are presented in 
Part IJ of this chapter. 



Two types of conditional analyeli; were subsequently performed on these data. 
B6th types are based on the general linear hypothesis. 

In the first analyses » two-way analyses of covarlance were performed on each 
of the four outcome variables (total readings word knowledge subscdre, word analysis 
subscore^ and reading subscore) within grade level (second and fourth). The 
treatment condition (saturated or concentrated) was used as the between-group variable* 
The five context or process rdeasure^ which showed the closest relationship were 
treated as covarlables. 

In the second analysis » multiple linear regressions were performed on these 
data. The mean reading achievement scores were regressed on several combinations 
of context and process variables to identify the most significant determinants of 
outcom% score variance* Through this analytical technique, an assessment of the 
instructional effects of several proceiss variables was possible when the effects of 
context variables were sufficiently controlled. Put more succinctly, once the 
class composition was controlled, the process (or Instructional) variables that 
accounted for differences in reading achievement were identifiable. The "process" 
determlnanjts identified by these multiple regression techniques were used ais 
covarlables in the analysis of covarlance. The findings from the multiple regressions 
"are reported in Part IV. 



Table 16 

Outcome Score Analysis for Crndc 2 Classes (Class-level Data) 



6 


Unadjusted Treat- 
ment Means 




AdiustediMeans 






Outcome 
Measure 


Cone* 1 
(n-13) 


Sat. 
(n«15) 


Significance 
of dlff (or) 


Cone. 


Sat. 


Beta 


r2 


Total Reading 


• - 


49. g 


0.79 


49.7 


:\. 59.6 


• 0.01 , 


*35 


Word Knowledge 


52.8 


" 52.4 




52.4 


52.7 


0.04 


^23 


Word Analysis 


48.2 


48.4 


0.83 


47.9 


48.6 


0.12 


.3*. 


Reading Subtest 


50.2 


49.8 


0.89 


49.4 


50.4 


0.12 


.21 


Average 


50.1 


50.1 


0.82 


49.8 


50.3 


0.07 


.2- 



of Covarlance on the 28 Second Grade C lasses 

7 

The results of the classroom-level analysis of effects within the second grade 
Bubsample (28 classes) are summarized in Table 16. Clearly, none of the observed 
treatment effects arfi statistically reliable. Less than one-third of the criterion 
variance (average r2-.296; maximum=.37; minlmum=.21) is demonstrated even when context 
and process covariables are Included. The magnitude and direction of the observed and 
adjusted mean differences for the second grade subsample clearly indicate the absence 
of reliable effects. In fact, the average of observed means across the four outcome 
measures is virtually identical across the two treatments (50.1). and nearly identical 
for adjusted means (49.8 for concentrated classes. 50.3 for saturated classes). 
Moreover, as indicated in a subsequent section of this study, the context and process 
covariables usually did not account for much additional criterion variance within 
thii second grade sample. 



Table 17 



Outcome Score Analysis for Grade /i Classes (Class-le\el Data) 



Unadjusted Treat- 
inent Means 





WwIlC • 




^xgnxixcance- 




/ 


Measure 


(n=14) 




of Dlff (■Hff ) 


Cone . 


Sat. 


Total Reading 


65.3 


61.6 


0.05 


65.2 


'f_ 61.7 


Word Knpwledge . 


67.6 


63. A 


0.02 


67.5 


-63.5 


Word Analysis 


(n 


o t " a p 


P 1 1; cab 1 e) 






Reading Subtest 


64.6 


61. A 


0.09 


64.7 


61.3 



Aditfisted Means 



Beta 



0.29 
0.33 

-\ 

0.27 



.56« 
.64 

.54 



Results of Analysis of Covarlance on the 28 Grade 4 Classes 

The results o£ the class-level analysis of effects wlchln the fourth grade sub- 
sample (28 classes) are summarized In Table _17. These results can be Interpreted as 

J ^ 
follows: 

(a) For both th^ total reading and the word knowledge measures, 
concentrated services produced reliably greater mean scores 
than did saturated services. These effects were evident both 
before apd after adjustment for process-context covarlates 
(which Include prescores) • 

(b) Mean differences on the reading subscore (basically a reading 
comprehension subtest) favor the concentrated condition (p<.09). 

c) The magnitude of these mean differences averages approximately 
four standard score polnt^s, or about 15 percentile points (based 
on the MAT equlpercentlle scale) • Specif Ically » based on national 
norms » the approximate percentile equivalents of the fourth-grade 
average scores are: 

Adjusted Mean Score 
Concentrated Saturated 



Total Reading 
Word Knowledge 
Reading Comprehension 



38 
40 
36 



24 
24 
26 




48 



\^ III. Results from Analyses of the Wlthln-Class Pupil Samples 

As was described In the observation component section^ a carefully defined 
sample was drawn for the purposes of Identifying differences In Instructional procedure, 
which might correspond to resource allocation condition (l.e.^ concentrated vs. saturate* 
"treatments"). The differences were sought In terras of pupil characteristics (gender, 
ethnicity, and relative disadvantage) , which could relate to putcorae patterns* Therefo: 
the observation component was prlmairlly designed to obtain evidence of differential 
effectiveness of either of the two resource targeting strategies in terms of individual 
differences among pupils. 

The basic within-class samples were selected to maximize EDY differences, 
while retaining an appropriate gender and ethnic composition across classes. Specific- 
ally class rosters were prioritized in terms of pupil quartlle on the previous year's 
MAT reading score. A sample of four pupils (two EDY, or Ql; two honEDY or Q3)* were 
dravm at random from each class .so that within grade level the samples were 
reasonably well balanced on gender and ethnicity as well. (Two alternate pupils were 
also designated— rone EDY and one nonEDY — within each class.) The resultant pupil 
samples constituted the targets for the individually focused instructional observation 
procedures, and for the pupil-focused analysis of effects. 

Even with these over-sampling precautions, problems of attrition and incomplete 
teacher data reduced the original sample of 288 pupils to a final sample of 219 pupils 
(56 teachers X A pupils/teacher should have yielded 224 pupils). These resultant 
overall and within-grade pupil samples are displayed in Table K[ and Table 11 on 
page 31 . 



Because very few Alum Rock elementary pupils score in QA, Q3 was selected as 
the more representative nonEDY population, y 



I 



Multiple linear regressions were performed. on samples within grade-level to 
Identify reliable context and process covariates of pupil achievement. The available 
measures for each pupil Included pre^ore (previous MAT standard scores for sub and 
total tests), design variables (EDY status, resource treatment, ethnicity, gender), and 
a set of process observation descrlptorsX Means and standard deviations on these 
variables are displayed in Appendix Bi3. , Ctonsequently, within each grade iBrci-post- 
scores were regressed on Available process an<l context variables, including the 
corresponding prescore. J 

The Identification of relevant process covarlates of outcomes was enhanced by 
attaching differential weight factors to the process variables In the stepwise procedures 
(i.e., "process" variables were weighted more heavily than prescores such that the 
regression analysis was "forced" to consider process variables before stepping prescores 
into the equation) • 

A) Grade ZTReRression Results 

Results of the regression analyses on the four outcome measures for the second 

grade sample are summarized in Appendix D.l. As demonstrated by these results, pupil 

1 

outcomes apparently are not well explained by available observation measures. The 
highest proportion of outcome variance explained by prescores and process measures is 
for the Total Reading score; however, this only amounts to 53.7%. Even for those process 
measures which apparently account for significant proportions of criterion score variance 
(e.g., typical role-group leader and total number of minutes the pupil was observed to 
be idle), the anticipated relationships materialized differently than expected. For examp 
time idle positively relates to outcome score, indicating that pupils with higher observe! 
idle time score higher on the post-tests. This probably indicates that teachers spent 
more time with EDY pupils, therefore neglecting nonEDY pupils, at least during the one- 
time pupil observation session. 

B) grade A Regression Results 

Formally identical regression analyses were performed on fourth grade pupil sample 
outcomes (see Appendix D.2). Although the amount of outcome variance was only slightly 
0_ greater for these 113 grade A pupils (maximum ■ 57.9% for Tot al Reading Score), the 

O.J , ■ " , •• 



significant process predictors are apparently In accord with find: ,;s reported in 
l4ted research. Specifically, there is consistently an Inverse relationship between the 
amount of time these pupils were engaged In ^nonlnstructlonal activities and outcome 
scores (p<.05). In other vords» the more observed nonlnstructlonal tlme» the lower the 
subsequent scores. ' 

Other measures which reliably account for outcome — specif Iclresults are both the 
relative amount of time pupils were ob^etved to be In the "receiving directions or 
a^sslgnments** mode (again negatively, relating to outcomes) and the overall Instructional 
grouping (whole class vs. staggered) 4 The data apparently indicates that whole-class 
instruction is more effective. 

r. ' f 

Regressions without EDY Status as a Context Variable 

When EDY status is excluded from the set of available regressor (i.e., context 
and process) variables » the results of the regression change in terms of both the rele- 
vant process-outcome predictors and the magnitude of explained criterion variance. The 
results of the second grad^ regression under this constra-lnt Indicate that patterns of 
materials usage (both in terms of amount and variability) marginally effect outcomes anc 
accounts foi; at most, 6% of the criterion variance (see Appendix E.l). The instruction 
modes observed in use during the 30-mlnute pupil observation sessions were even less 
effective (accounting for generally not more than 3% of the outcome variance). 

This pattern of results also occurred for regressions of fourth grade measures on 
process variables (excluding EDY status), (see Appendix E.2). Essentially, the only cle 
distinction between second and fourth grade regression results is the total outcome 
variance explained (maxSjLmum for grade 2 46%; maximum for grade 4 68%) , which is a 
direct consequence of the stronger pre-post correlations observed for grade 4 data. The 
process variables collectively never exceed 10% explanation of criterion varianceT^Te*- 
gardless of measure or grade level. Accordingly, these **best available" process 
covarlates were Included with the relevant prescores in the subsequent analysis of 
varlance/covarlance of pupil-level learning outcomes. 



It should be noted that although EDY status was defined as a context variable, it 
•ct^ially strongly aliases prescores» Hhlch~ are used to establish EDY status. 



Analysis of Covarlance Results 

Results from regressions on each wlthln-grade level sample were us^d to define 
the most relevant covarlables for each outcome measure, which would ::be subsequently 
analyzed In terms of the sampling design* Moreover, two forms of the outcome measures 
were analyzed: . 

(1) the Spring 1978 MAX standard scores 

(2) Spring 1977 to Spring 1978. MAT "change" scores (standard). 
Results are reported separately within each grade level sample* 

A) Grade 2 Spring 1978 Outcomes 

The results of the four-way analyses of covarlance for the second grade pupil 
sample for the Word Knowledge, Word Analysis, Reading Comprehension,, and Total Reading 
measures are presented in Appendices P*l through. F*A* Although some differences in 
significant main effects and interactions are obtained from measure to measure, the 
general pattern of findings appears to be as follows: 

(a) Evidence for overall superiority of concentration or saturation 
did not approach statistical significance* 

(b) Even after adjusting for prescores as covarlables, differences 
in outcomes in terms of initial EDY status remained highly 
significant (p<*001). , 

(c) Evidence of differential effectiveness of treatmetft (concentration 
vs* saturation) by EDY condition did not approach slgnlf icance, 

(d) Only for Word Knowledge scores were reliable patterns of differen- 
tial effects of treatments in terras of ethnicity or gender within 
EDY status found to occur* 
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^able 18 
Spring Test Scores — Grade 2 



Concentrated (52.7) 



WORD KNOWLEDGE 


EDY (46.8) 


* NON-EDY 


(59.3) 




Girl 


Boy 


* Girl 


Boy 


. Spanish 


47.4 


46.2 » 


51.7 


61.4 


Caucasian 




49.0 


62.8 


67.0 


Dlacic . 


52i0 






57.0 


. Other 

• 




46.0 • 


67.0 


51.0 


Total 


42.4 


45.4 


58.0 


60.4 




Concentrated (51.2) 




READING COMPREHENSION 


EDY 


(44.8) 


NON-EDY 


<58.3) 




Girl 


Boy 


Girl 


Boy 


Spanish 


44.8 


43.2 


57.4 


53.4 


-Caucasian 




45.8 


60.3 


68.0 


, Black 


51.3 






53.0 


\ 

^ Other 




31.0 


04.0 


6'2.0 


Total 


46.2 


43.5 


60.2 


56.7 

1 


Concentrated (50.8) 




TOTAL READING 


EDY 


(44.9) 


NON-EDY 


(57.4) 




Girl 


Boy 


Girl 


Boy 


Spanish 


44.9 


43.9 


58.8 


53.8 


' Caucasian 




44.0 


60.7 


68.5 


Black 


51.7 






53.0 


Other 




38.0 


74.0 


56.0 


Total 


46.4 


43.5 


58.9 


56.1 



Saturated (53 > 8) 



EDY (49.0) 


NON-EDY (59.7) 


Girl Boy 


Girl Boy 


48.3 49.7 ' 
67.0 50.2 
50.5 41.0 


58.7 

53.0\. 63.0 
54.5 

- ■ \ ■ 


49.9 48.1 


58.9 60. 6\ 



Saturated (A9>3> 



EDY (43.6) 


NON-EDY (56.4) 


Girl Boy 


Girl Boy 


50.0 48.2 
42.0 37.5 


COO C ^ /\ 

,58.3 56.0 
54.3 58.4 
49.5 


42.4 ' 44.9 
Saturate 


55.8 57.2 
d (49.7) 


EDY (44.4) 


NON-EDY (56.4) 


Girl Boy 


Girl Boy 


42.7 44.6 
51.0 48.0 
43.5 41.5 


58.8 55.8 
52.3 ' 59.0 
49.0 


43.4 45.4 


55.6 57.4 



50. 
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To aid In interpreting these patterns of results » xnean^^scores" by design 
condition are' SD^mnarlzed by each outcome measure and are presented In T^ble 18. 
Clearly 9 overall averages by treatment rarely differ by more than one standaro score 
unlt» whereas EDY/nonEDY. differences are quite large (10 or more standard score 
points}' and relatively consistent across treatme;nt conditions. ^ 

In terms of within-distclct norms ^ these outcomes can be interpreted as 



follows: 



) 



\(a) Concentrated EDY pupils averaged at about the 36th , percentile; 
^ concentrated nonEJHY pupils ^t the^75th. Saturated EDY pupils 
averaged^ at about the 33rd percentile; saturated nonEDY at 
about the 73rd. At most» concentration has provided about 
5 percentile points educational advantage to these second-grade 
pupils. 

A weak differential trend suggests that saturated methods 
might be more beneficial to boys (59th percentile) than girls 
(52nd percentile) 9 with the opposite l^ing the case for concentrated 
methods (boys « 55th percentile; girls » 63rd percentile) « 
However » these patterns failed to reach statistical significance. 




V 



B) Grade 2 Difference Scorft Analyses ^ 
In terms of the net educational benefit produced by these •^treatments," analysis 
of the patterns of available pre-to post-score change was conducted using relevant process 
variables as covarlates (as identified through'^^peparate regression analyses conducted on 
pre-post change scores).* The results of these analyses are presented in Appendices G.l 
through G.3 with the corresponding difference mean scores summarized in Table 19. 



' Table 19 

Pre-Post Change Scores — Grade 2 



I WORD KNO;^EDGE 



Concentra 



ted (10.8) 



EDY (11.7) 



Girl 



Boy 



Spanish 12.9 10.0 

Caucasian 12.2 

Black' 11.3 

other — 12.0 



Total 



12.5 



10.9 



NONEDY (9.8) 



Girl 



Boy 



6.0 
12.7 

20.0 



9.8 
19.0 
lA.O 
-3.5 



iO.2 



9.5 



Saturated (11.5) 



EDY (1A.7) 



Girl 



15.3 
2A.0 
15.0 



15.9 



Boy 



12.0 
17.6 
10.7 



13.6 



KOKEDY (7.5) 



Girl 



16.6 
-7.3 
-5.0 



7.0 



Boy 



6.0 
10.6 



8.1 



11. 



I WORD ANALYSIS I 




Total 



Saturated (9.2) 



EDY (9. A) 



Girl 



Boy 



10. A 
5.0 
13.0 



6:8 
12.0 
8.7 



10.2 



8.7 



KONEDY (9^.0). 



Girl 



11.0 
7.7 
11.5 



10.2 



6.0 
10.2 



7.7 



Concentrated (11 >6) 



TOTAL READING | 


EDY (12 


.8) • 


NONEDY 


(10.5) 




EDY 


(11.2) 


NONEDY 


(lO.A) 




Girl 


Boy 


Girl 


Boy 




Girl 


Boy 


Girl 


Boy 


Spanish^ 


13.4 


11.0 


9.2 


7.7 




10.3 


9.7 


14.3 


10.8 


Caucasian 




13.2 


12.7 


22.5 




11.0 


16.4 


0.7 


12. A 


Black 


16.0 






10.0 




10.5 


9.5 


5.5 




other 


0 


8.0 


31.0 


-2.5 












Total 


14.0 


11.7 


12.8 


8.5 


10.4 


12.1 


' 9.4 


11.6 



Saturated (\0.9) 



O Because of changes In subtest content across years, 
ElyC shad corresponding prescorcs.- ' 



not all" outcome measures^ 



51. 53 



11. 



These results, show that strong differential gains occurred only for the Word Analysis 
subtest (p<.01). These gains were most marked for EDY pupils in saturated class 
and least marked for nonEDY pupils in saturated classes (see Table 19). Based on local 
norms, the EDY pupils in saturated class apparently moved from the mean percentile rank 

of 30 in theSpring of 1977 to the ni atnpM^^^^^ 

in terms of Word Knowledge skills. NonEDY pupils in saturated classes lowered their 

score from the 86th percentile in Spring 1977 to the 77th percentile in Spring 1978. The 

I. ' 

results for both EDY and nonEDY pupils in the concentrated classes on the same subtests 
are as follows: 

Mean Percentile Rank (Word Knowledge) , ^ 

Spring 1977 Spring 1978 Net Change 

Concentrated EDY 33 . 35 -f 2 

Concentrated nonEDY 80 77 - 3 

A table of net percentile rank change (again based on within-ditstrict norms) on 
Total Reading scores for the second grade sample is as follows: 

Mean Percentile Rank (Total Reading) 

^ / Spring 1977 Spring 1978 Net Change 



Concentrated EDY 


27 


36 


+ 9 


Concentrated nonEDY 


82 


79 


- 3 


Saturated EDY 


27 


34 


+ 7 


Saturated nonEDY 


85 


75 


-10 



Therefore, using relative within-school district status as the effectiveness criterion 
concentration is apparently a superior treatment to saturation. This interpretation 
cannot be advanced unequivocably, however, since these score patterns are at least 
partly influenced by the regression-toward-the-mean phenomenon inherent in pre-post 
analy^^s. 



iil Kcsuits ot the Grade A Analyses 

Analyses formally identical to those reported above for the second grade sample 
were conducted on the fourth grade sample (102 pupils); however, the Word Analysis Sub- 
score was not available for the reading test used at grade 4 (the MAT elementary level), 
and the readtng^comprehension difference scores were unavailable for this sample. The 
results of analyses -of Spring 1978 outcome measures are presented ixi Appendices H.l 
through H.3. The corresponding averages are summarized in Table 20. 



WORD KNOWLEDGE 



Table 20 

Spring 1978 Test Scores— 

Concentrated (66.6) 



Grade 4 



EDY (60.2) 



Girl Boy 



Spanish ' 
Caucasian 
Black 
Other 



61.7 
60.7 
55.5 
59.0. 



60.2 
66.0 
56.5 



Total 60.3 60.1 
READING COMPREHENSION 



NONEDY (76. A) 



Girl 



Boy 



76.0 
74.7 
73.0 
6A.0 



73.0 
72.0 
101.5 
70.0 



74.2 



80.6 



Saturated (64.3) 



EDY (56.6) 



Girl Boy 



55.9 54.1 
60.0 50.5 
55.5 59.0 
59.0 



56.2 55.1 



NONEDY (72.7 ) 



Girl 



Boy 



71.7 
78.8 



69.5 
74.5 
73.0 



Concentrated (64 . 6) 
EDY 058.3) 



Girl Bo 



Spanish 

Caucasian 

Black 

Other 



61.2 53.4 

60.7 \^77.0 

52.0 16(0.5 
71.0 



16(^5 
" \ 



Total 



56.1 



NONEDY (73.8) 



Girl 



Boy 



75.8 
71.2 
74.0 
60.0 



73.7 
64.0 
89.5 
72.0 



72.3 



TOTAL READING 



60.4 

Concentrated (65.0) 



76.6 



Satura 



EDY (58.5) 



Girl Boy 



48.7 56.5 

62.0 49.5 

53.0 55.0 

— 49.0 



50.9 53.8 



74,3 
ted (63.3) 



71.4 65.5 



NONEDY 72.4) 



Girl 



Boy 



73.0 
74.2 



70.4 
72.5 
74.0 



73.4 



71.5 63.8 



EDY (58.2) 


NOK^EDY (74.9) 




EDY (53.1) 


NONEDY (71.9) 


Girl Boy 


GirlX Boy 


Girl Boy 


Girl Boy 


Spanish 60.3 56.5 
_ ^Caucasian 58.8 69.0 
Black 53.0 56.5 
Other 62.0 


76.0 V 73.0 
72.2 \7.0 
73.0 9^^ 
61.0 71. 0\ 


51.6 53.8 
59.0 49.0 
53.0 56.5 
— 54.5 


71.9 69.1 
76.0 72.8 
73.0 


Total 58.9 57.4 


72.8 78.7 




52.6 53.5 


73.4 70.7 



Saturated (63.1) 
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As distinct from the second-grade results, clear dlf ferenCCi? associated with 
treatment are found for these grade A pupils on both the Word Knowledge and Total Readint 
scales. Moreover, when the preceding scores for these pupils are used in analysis, as li 
done in the analyses of difference scores reported in Appendices 1. 1 and 1.2 and sucnarizec 

In Table 21, the effects become even more marked. 

' ; * Table 21 = . 

Prfe-Post (Change) Scores— Grade A -. 

Coneentrated (6.2) Saturated (A.l) : y 



OWLEDGE 


EDY (6.0) 


NONEDY (6. A) 


1 

EDY 


(5.6) 


NONEDY 


(2.6) 




Girl 


Boy 


Girl 


•Boy 


Girl 


Boy 


Girl 


Boy 


Spanish 


9.2 


A. 6 


5.2 


2.7 


A. A 


6.6 


1.3 


-2.0 


Caucasian 


7.8 


9.0 


A. 8 


5.0 


8.0 


2.5 


8.0 


6.5 


Black 


0.5 


5.0 


-A .0 


3A.5 


A.O 


8.5 




7.0 


Other 


2.0 




-6.0 


6.0 




7.5 






Total 


7.0 


5.0 


3-1 


12.6 


A. 6 


6. A 


3.- 


1.7 



5. 
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READING (6:6) 


NONEDY (A. 7) 


EDY (5.0) 


NONEDY (3.2) 


Girl Boy 


Girl Boy 


Girl Boy 


Girl Boy 


Spanish 10.3 3.7 
Caucasian 9.5 12.0 
Black -1.0 8.5 
Other 6.0 


A. 8 0.0 
2.3 1.0 
-8.0 27.5 
-1.0 8.0 


3.0 8.0 
6.0 3.5 
2.0 6.0 

' — 6.5 


1.7| 0.9 
5.2 6.0 
8.0 


Total 8.2 5.0 


2.2 9.1 


3.1 6.7 


3.0 3.A 



The concentrated treatment provided more 'desirable effects than the saturated 
treatment. These patterns of outcomes caiybe displayed most clearly as relative effect: 
shifts in within-district percentile rartUngs. Specifically, for Total Reading measure 



is as follows: 




Mean Percentile Rank (Total Readinp;) 




Sp' 


rinc 1977 


SorlnR 1978 


Net Chaiige 


Concentrated EDY 




18 


30 


+ 12 


Concentrated nonEDY 




91 


88 


- 3 


Saturated EDY 




18 


19 


+ 1 


Saturated nonEDY 




90 


81 


- 9 
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Essentially* the relative vlthln-dlstrlct rank of EDY fourth-grade pupils receiving 
concentrated services increased by an avcrageof 12 percentile rank units, whereas 
their nonEpY counterparts stayed relatively stable (declined 3 percentile rank units). 
In comparison » the EDY fourth-grade pupils receiving saturated services increased their 



Tanking only 1 percentile rank unit over their relative within-dis4trict ranking the 
preceding year» while their nonEDY counterparts declined an average of 9 percentile 
rank units. > . . 

A similar analysis of relative shifts on the Word Knowledge scale reveals the 
following patterns: 

Mean Percentile Rank (Word Knowledge) 





Spring 1977 


Spring 1978 


N^t 


Change 


Concentrated EDY 


30 


34 


+ 


A 


Concentrated nonEDY 


88 


88 




0 


Saturated EDY 


2o.,_ 


17 




3 


Saturated nonEDY 


88 


78 




10 



Again there is an upward shift for concentrated EDY, a doxmward shift for saturated 
EDY» virtually no shift for concentrated nonEDY/ and a marked decline for saturated 
nonEDY. 

One possible explanation is that the teachers in the saturated classes 
frequently interpreted their assignment as providing resources equally and uniformly 
to all pupils » rather than making resources available to all pupils on the basis 
of diagnosed need. Therefore » teachers in the saturated fourth grade classes 
mechanically implemented the compensatory services (the data indicates the teachers 
in the saturated classes did this significantly more frequently than teachers in 
the concentrated classes). Consequently, neither EDY or nonEDY pupils benefited. 
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Alternatively, the data Indicates that the teachers In the concentrated classes 
provided differential services according to pupil need; therefore, both EDY 
and nonEDY pupils benefited. 

An alternative Interpretation of these results, also Indicated by the' 
observation findings, Is that concentrated teachers were more likely. to segment 
their class, and make use of aides and resource centers to Intensify* services 
directed at the poor-performing pupils. Therefore, these findings might Indicate 
that not only did the EDY pupils receive appropriate individualized assistance 
but also the teacher appropriately differentiated methods and materials to the 
nonEDY pupils. Since many teachers in the fourth grade saturated classes 
apparently felt they were expected to treat all pupils equally (even though they 
clearly could not), it is reasonable to conclude that they were less inclined 
to individualize, by using either pullout/resource center facilities, differential 
instructional methods or materials matched to pupil ability. If this second 
interpretation is correct, then the effect of asking teachers .to ^'saturate" 
services may, in their perception^ be equivalent to asking them to homogenize 
instruction. 
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IV, Multiple Regression Analyses Results 

Even though the analyses of covariance Indicate a substantial benefit may be 
associated with concentrating compensatory services » particularly In the upper 
^^^"^"^^'^7 such analyses do not Identify the Instructional components 

associated with these benefits. In addition ^ these analyses do not evaluate other 
features of instructional programs (e.g., use of human and material resources, engaged 
time patterns, teacher style,, etc.) 'which may account for additional differences in 
reading achievement. To facilitate additional analyses and evaluation of these 
features, a series of stepwise multiple linear regressions were perfdrmed on outcome 
measures within each grade-level Sample. Basically, this analysis attempts to discover 
What are the pro cess and context characteristics at the classroom level which best 

account for diff erences in mean achlTevement on criterion tests ? The results of these 

analyses, confirm and extend the results of the covariance analyses. 

Grade A Class-level Regressions 

Outcome measures (Spring 1978 Total Reading and subtest average standard 
scores) for the 28 fourth-grade classes having complete data (interview, observation, 
and test data) were separately regressed on process and context Indicators. A 
forward stepwise procedure was used which restricts inclusion to significant predictor 
variables. However, once a variable was Included, it remained in the equation 
regardless of subsequent changes in Its predictive significance* 



Three criterion tests available for the grade A sample (Total Reading, Word 
Knowledge, and Reading Comprehension) are reported. ■ 



Total Reading Achievement 

Average standard scores on the Total Reading scale for the 28 fourth grade 
classes yielded an unusually high degree of statistical explanation when regressed on * 
context and process measures. Altogether^ 13 measures entered Into the explanation of 
Risadlng BcorenDutco^^^^^ 

level C-OS). The resultant multiple correlation is .989, Indicating that nearly all 

(l.e.» 97.7%) o£ the variability in outcome measures has been "explained" by these 

relevant context and process measures. Ev^en adjusting the solution for the number of 

2 

predictors^ the explanation still accounts for better than 95V, (adjusted R ==.956) of 
test score variance. 

Although the regression solution has identified a llne«ir combination of both 
context and process determinants » for Interpretive convenience they are presented 
separately. Two statistics are reported for each determinant:; a standardized Beta 
value» indicating the relative potency of the determinant (l.e.» the expected unit 
change in the criterion for a unit change in the determinant » all other determinants 
held constant) » and a step (or univariate) F value » indexing the reliability of the 
determinant (F>4.5» p<.05). 

Context Determinants 

Fourth grade classes generally achieved higher overall reading scores to the 
extent they consisted of: 

Stepwise 
Beta F 

(a) proportionately fewer Spanish surname pupils -.269 11.20 

(b) proportionately more Anglo/caucaslan pupils .242 9.14 

(c) proportionately fewer girls -.179 12.69 

CoAdltlons which approached significance in relating to above-average Total Reading 
achievement were: 

Stepwise 

■ Beta G 

the use of whole class (as opposed to staggered) 
reading instruction -.116 3.94 

* a higher average age of the class .Q21 1.03 



.;■> 

Process Determinants 



In addition to these context determinants, the following Instructional character- 
istics added significant explanation of Total Reading achievement (I.e., represent the 

. ■ . ^ \ , ' 

significant process determinants) : \ 



\ 

\ 

\ 



. Stepwise 
Beta F ' 



(a) the classroom received concentrated services \ ,^303 33 ,44 

(b) Individual pupils were dbseryed to make a \ 

wider use of materials '\ ,685 175.10 

(c) teachers were observed to make proportionately 

greater use of EDY materials ^527 76*16 

(d) more observed variabllty (viz Individualization 

in the amount of time pupils were being managed \ ^ 

or receiving directions ■ ,313 54^47 

(e) pupils were less often observed making use of ^ 

EDY materials -.303 28*79 

(f) teachers reflected a more thorough understanding ' 
and correct implementation of their respective 

resource strategy (concentrated or saturated) ,348 20*29 

(g) teachers were observed to be more variable in 

the amount of time spent in directive roles ,233 13,A5 

(h) teachers were less extensive in their affective 

responsiveness to pupils -•153 6,07 



This analysis indicates that the class achieving the highest performance level 
has relatively more older Caucasian males, relatively few young Spanish surname females^ 
and is led by a teacher who concentrates resources on EDY pupils, individualizes 
Instruclon and the assignment of materials, more clearly understands resource management 
and the concentration/saturation experiment, balances activities between giving direct 
instruction to small groups vs* providing directions to pupils for self-instruction, 
and uses positive/negative feedback more conservatively (or selectively) • 
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Word Knowledge 

Analysis o£.c»„ fourth grade cla»sroo. standard scores on the Word Knowledge 

subscale yielded a high explanation «hlc, trlklngly similar to that reported for 

the Total Reading scores. Specifically, the overall multiple R on eight regressor 

.,arlahle.»es.OPPUted.as^^^^..^^^^^ 
"explained- by these eight predictors (r'-.SU). The adjusted R for this solution 1. 
.877. and the F value for' this equation Is 25.10 (df=l,19). Again, the Interpretation 
of this result Is presented In ter^: of context and process variables separately. 
Context Detenttinants 

m terms of context variables. «ean perfora^nce on Word Knowledge subtests 

Stepwise 

vas higher to the extent: Beta F 

(a) the classroom was made up of older pupils -158 A. 83 

(b) the classroom consisted of an above-average ^ .^^ 
proportion of caucasian/anglo pupils 

in addition, context variables which, originally significant, generally related to score 

patterns (but which are dominated by process variables) are: stepwise 

Beta F 

lower proportion of Spanish surname pupils -190 2.75 

. whole class (as opposed to staggered) reading ^ .^^^ ^^^^ 

Instruction ' 

Process Determinants 

The cumulative explanation avSlable through these context determinants Is. at 
^ximum. 42%. Nearly 50% additional explanation Is found with the four significant 
process determinants, whl^are Interpreted as Indicating that classroom score above 

) Stepwise 
average to the extent: / Beta F 

, „ .31A 18.47 

(a) the teacher concentre u I resources 

(b) pupils were observed to use a l^^l" """^^^ .586 56.78 
of materials over the course of instruction 

(c) teachers were observed to make use of a higher ^^^^ ^^^^ 
proportion of EDY materials 



Average standard scores on the MAT R^adlne comprehension subscale were also 
regressed on conte« and process variables. As with the Word Knowledge scores, results 
for this analysis are ,„ite similar to the total score results at a general level, with 
^nly -inor '[^^tions in specUU detegin^ts. An^pveraU solution Involved -nln^ vart 
.ble.. »ith . multiple correlation of .956. accounting for 91.5X of the total variance 
on Reading comprehension scores. Ihe adjusted «f is .872. with an F on regresfton of 
21.46 (df.g.ia). 

Context Determinants i 

The interpretation of this result in terms of context determinants Is that high 
Reading comprehension scores were obtained for classrooms consisting of: 

Stepwise 

/ X Beta F 

(a) Dore pupils of above-average age ,240 10.25 

(b) larger percents of anglo/caucasian pupils .340 7 66 

(c) fewer pupils of Spanish surname* no 

— .xxy 0,94 

collectively, these context determinants account for a maximum of 39% of all criterion 
variance. 

Process Determinants 

The remaining 52% of criterion variance Is explained by the six process deter- 
minants, which indicate that mean scores on ReadinL comprehension Increase to the extent: 

Stepwise 

A Beta F 

(a) teasers concentrate services ' ,-,0 -.^ 

... \ . •372 17.70 

Kt>) pupils\were observed to make use of a larger 

number (^ariety) of materials 7qo ^, 

^ . \ ''^a 74.51 

(c) greater vaViation in group leadership was observed 
for individual pupils (e.g., use of aides, peers, etc.) .196 5.50 

(d) teachers were observed to make greater overall 
use of EDY materials 



(e) more variation existed In time spent giving 
individual pupils directions 216 

(f) less variation 'over time was found in the rela- 
tive amount of pupil time spent in seatwork 

and self-instruction - 204 



229 9.02 
8.22 



3.79 



Viginally significant, but subsequently aliased by percent Caucasian. 



Grade 2 Classrooni'-lcvel Regressions 

Findings from regressions of criterion scores on context and process measures for 
second grade classes demonstrate neither the regularity nor the strength of association 
that was indicated by the findings from fourth grade classes. Again using classroom 
aggregated statistics on each category of measures (context, process, outcomes), 



separate stepwise regressions were performed on the Word Knowledge^ Reading Comprehensio 
and Total Reading means for the 28 second grade classrooms. The^ results" of 'these analyse 
are described and interpreted^ as follows: 

Word Knowledge 

The analysis of context and process determinants^ of Word Knowledge produced a 

2 

surprising result. Approximately 74% of the criterion variance (R =«745) is explained 

by four variables (multiple R=.863, F-16.77, df=4,23) and can be interpreted as showing 

second grade classrooms averages on Word Knowledge subtests increase to the extent: 

Stepwise 
Beta F 

(a), the classroom was composed of a smaller porportion 

of black pupils -.430 13.91 

Cb) the teacher was observed to make below-average use 

of EDY materials relative to all materials -.561 23.64 

(c) the teacher was observed to be more variable in the 

amount of time spent giving directions .219 A. 24 

(d) the teacher's previous class was above average 

on Word Knowledge « •333 9.81 

One reasonable interpretation of this pattern of findings is that, for these 
second grade classrooms. Word Knowledge achievement is more strongly determinecl by 
characteristics of the pupils than by Instructional methods per se , and furthermore, 
that teachers are adapting their methods and materials to these contextual differences 
(i.e., classroom composition). Since prior-year class score also reliably accounts 

♦ 

for current outcomes, this possibly is evidence of a teacher effect (i.e., certain 
teachers are consistently associated with high«-achieving classes, others with low- 
achieving classes] • However, a more feasible explanation Is that this effect reflects 
stable population differences associated with school attendance areas within the 



district. These attendance area population differences would be manifest as differences 
In relative EDY composition at the classroom level^ and would necessarily show up as 
constant differences in classroom achievement. Furthermore, this interpretation is 
consistent with EDY-use findings: namely, classes consisting of low < percentages of EDY 
piiplls wbul^^ expected to make less frequent use of EDY materials/ and vice versa/ 

This regression result indicates, that, in the second grade, ^the use-of 
Instructional procedures (methods and materials) apparently do not overcome learning^ 
differences associated with soclo-cultural group membership (perhaps as aliased by 
school attendance areas), at least with respect to Word Knowledge achievement measures. 
It does suggest that teachers are targeting resources (EDY materials) to perceived 
pupil xieeds; however, this targeting is highly correlated to ethnic group 
membership (again a correlate of school attendance areas). 



Reading Comprehension 

Results for regression of second grade Reading Comprehension means on context 

and process variables essentially replicate those found with Word Knowledge, except 

that far less criterion variant is explained. Only two reliable "predictors" of 

second grade reading comprehension were found, accounting for less than 30% pf the 

2 

outcome variance (R=.5A6, R «.298, F»5.31, df«2,25). They are: 

Stepwise 
Beta F 

(a) the relative use of EDY materials by the teacher -.A79 7.96 

(b) the mean reading comprehension scores obtained 

by the previous year's class .109 A. 22 

Again, high average scores occurred for classes in which teachers make less use of EDY 
mateials and for whom the teacher's ptior year's class also scored above average. This 
is consistent with the interpretation that context (or school) effects dominate the 
outcomes, event though the teachers properly target resources.* 



Note; We also considered the alternative interpretation that the ^:se of EDY materials 
and resources serves to depress scores. But in the absence of a difference due to 
concentration vs. saturation of EDY materials, this Interpretation is considered less 
tenable. Rather, agc^ suggested In findings for Word Analysis outcomes, it appears 
^ that a large proporilon of second grade teachers simply refused' to implement their 
FRir P'^«®c'^l*>ed treatment. 
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Word Analysis 



The MAT second grade battery (Primary II) provides for an additional skill area 
described as Word Analysis. Regression analysis of this measure on process and context - 
variables produced some surprising results. 

Virtually all of the criterion, variance on this measure has been "explained" by 
a combination of ten context/process descriptors (eight of which remain highljf'* reliable).. 
The multiple correlation is .9B1, accounting for over 96i (R^«.962) of the variation 
^n Word Analysis mean scores (F=38.36, df=10,15)'. Even adjusting for the number of 
predictors^ the explanation is still extraordinarily high (adjusted R^=.937). ^This 
result indicates mean scores on the Word Analysis subtest Increase to the extentt. 







Beta 


Duepwxse 
F 




(a) 


black pupils ) 


-.487 


61.45 




fb^ 


une ueacner uses suaggerea ^as opposea co wnoie 
class) reading instruction ^ 


.040 


0.31 




(c) 


the teacher was observed to use proportionately 
fewer EDY materials 


-.970 


118.62 


/ ' 

/ 


(d) 


the teacher was more variable in the assignment 
ot pupil seatwork/self-instruction 


.433 


59.73 






the teacher was less in compliance with her/his 
respective treatment condition 


-.082 


2.00 






the teacher *s prior class scored above average 
on the Word Analysis subtest 


.908' 


106.60 




(g) 


the teacher perceived her/his resource .targeting 
guidelines (l.e.» treatment) to be at variance 
with the-dlstrlct policy 


.402 


44.54 




(h) 


the proportion of girls in the class was above 
the overall sample average ( 


.545 


44.55 




(i) 


the teacher saw hlm/herself as primarily responsible 
for learning outcomes ' « 


.403 


25.26 


•t 


(j) 


the teacher tended to be moi^e demonstrative in the 
use of positive and negative affective responses 


.258 


15.41 


1* 
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Basically » this resu^^&^-^^thvreinforces and elucidates previous findings regarding 
determinants of Word Knowledge and Reading Comprehension scores in these f^econd grade 
classes. Specif ically, the context determinants account for better than 46% of outcome ^ 
variance, witlfi about 50% attributable to proc^ characteristics (including teacher 
attitudel^ about the validity of the experiment). This corresponds closely with findings 
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for the fourth grade sample, where process measures genlraiiy account for about 50Z of 
the criterion variance. This result Is consistent with ^ Interi^retation that school/ 
conanunity characteristics significantly influences teacher strategies and subsequent 
outcomes In this second grade sample. 

Even more startling, however, are the findings relating' teacher attitudes 
and behaviors (regarding the targeting of resources) to subsequent outcome 'patterns. ' ' 
The teachers with higher attaining classes apparently thought that the "treatment" 
definitions were vague and arbitrary; therefore, their behavior was influenced by 
this opinion. Moreover, .these teachers attribute the achievement of their pupils 
to their own teaching methods (rather than to resources and administrative support) . - 
These second grade teachers apparently assert that they know hbw to optimally 
allocate resources, and to a considerable extent the findings corroborate this assertion 
The strong negative influence of ethnic compositiomof the classroom to outcomes is 
still troubling; clearly, the relationship between ethnicity and learning has 
not been overcome by these teachers, and ne/ds further Investigation. 

Total Reading Score ' ( 

The overall relationship between Total Reading score and context/process character 
istics is shallow for these second grade classrooms, and is far more difficult to inter- 
pret than the subscore findings. Only two variables were found to reliably account for 
Total Reading scores at the second grade: 

' Stepwise 
h Beta F 

(a) observed use of EDY materials / '-.473 - 8.20 

(b) mean age of pupils . , ^,2lA - A 62 

Approximately 32% of outcome variance Is accounted for by these measures (R=.564, r2=.316 
F-5.83, df=2,25), and as the .beta coefficients show, In both cases the predictor rela- 
tionships are Inverse (lower mean age and use of EDY materials account for higher 
outcoine scores) 
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One plausible interpretation is that. this finding reflects, in part. 



\ ■ 

\ 



the confounding of second grade retention policies. In other words, it is 
conceivable that classes of above-average pypil mean age contain disproportionate 
numbers of slow learners who are repeating the second grade. This, in turn, would 
account for the negative relationship between mean pupil age and mean' achievement. 
Unfortunately,, at the tine of this writing, data are not available to corrqborate 
this interpretation. 
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SUMMARY CONCLUSIONS 

Alum Rock Union Elementary School District participated as one of 11 national 
demonstration -sites to assess the relative educational effects of variations in 
school-wide targeting of compensatory services. The effects of the concentration 
and saturation methods provide the general focus of this report. 

The data used in assessing the relative effects of these two resource provision 
conditions were provided by establishing a matched sample of 18 schools which 
were randomly assigned to "saturation" or "concentration" of EDY resources. Two 
basic questions guided the analysis of the data: 

1. Does saturation or concentration of compensatory resources 
and services--to the extent such occurred in this study- 
related to reliable and meaningful differences in basic 
reading skill attainment? 

2. What are the contextual and procedural (instructional) 
conditions which account for differences in reading skill 
attainment? 

An additional objective was to determine the central and peripheral effects of 
the allocations of these treatments on classroom practices and pupil learning 
(reading, as measured by MAT). The objective was to determine the characteris- 
tics of pupils* resources, and instructional procedures which combined to account 
for learning outcomes (i.e., reading skills, as measured by the MAT). ^ 

Some of the major findings of the observational component were: 

1. Teacher Roles 

More than three roles were observed in only 10% of the teacher-focused 
observatyons. The maximum number observed was five. Diversity of 
teacher/roles did not differ reliably across treatment group or grade 
levels. The most common teacher activities observed were oral or 
silent reading and reviewing (24%), drill (23%), classroom management 
(1555), and assigning tasks (9%). Together these four activities 
represented 71% of all teacher roles observed. These roles were 
predominant across treatment groups and grade levels. 




Summary Conclusions (continued) 

// 

2. Pupil Roles 

Many of the pupil roles were the counterpjart to teacher roles. The 
most common .activities Involving pupils^orking with the teacher were 
oral/silent reading and review (22«) aifid drill (20«). Receiving 
assignments and participation in cla;ssroom management activities 
represented B% and 9% of all pupil/^roles, respectively. Two additional 
roles were fairly qphmion among puj(lls: seatwdirk (completing asslgnments- 
1 IX); and transition' (wafting for a new task or the teacher's attention— 
6%). Together these activities'^ accounted for three- fourths j)f all" the 
pupil roles observed. / 



3. Engaged Time 

A measure of engaged time was generated for each of the 219 pupils 
by calculating the total number of minutes each spent in all roles 
classified as instructional. Second and fourth-grade pupils spent 
an average of 872 and 90% of their time, respectively, engaged in 
activities directly related to instruction. Reliable differences 
between treatment groups were not found at either grade level. -EDY 
■ and non-EDY students in both saturated and concentrated classes 

generally had a high proportion of engaged time. In the fourth-grade 



concentrated classes, EDY pupils spent an average of 95% of their 
time in instructional roles, while the ndn-EDY pupils spent an 
average of 85%. 

4. Teacher-Pupil Interaction 

The teacher- initiated interactive mode clearly dominates, accounting 
for an average of 70% of teacher time. The directive and facilitative 
modes together represent an average of 25% of teacher time. Discussion 
and social interaction are comparatively rare. Pupils working with the 
teacher during reading instruction spent an average of 65% of their time 
in the responding mode. .Most of their remaining time was spent complet- 
ing seatworfc assignments or working on self-instructional activities. 
A comparison of the teacher and pupil profiles showed strong similarities 
in the relative proportion of time spent in corresponding teacher-pupil 
modes. Teachers in the saturated classes spent 70% of their time in 



^ Summary Conclusions (continued) 
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the interactive mode. Correspondingly, the pupils in those classes 
spent 72% of their time in the interactive mode, x^,. 

Teachers in concentrated classes spent more time monitoring or > 
assisting their pupiTs than teachers in the saturated classes. 
Pupils in concentraTed classes spent an average of 28% of their time 
in seatwork and self-instruction. This represents almost twice the 
percentage spent by pupils in the saturated classes. Teachers in 
concentrated classes spent a significantly greater amount of time 
facilitating activities than teachers in saturated classes. 

One possible explanation is that teachers in concentrated classes 
used various modes of instruction as a technique for concentrating 
services on EDY pupils. Unfortunately, data from the individual 
observation Instrument did not show systematic differences in use 
of time by EDY and non-EDY pupils in the concentrated classes. 

;5. Materials ' ^0 ' 

The average number of different materials used during a ten-^minute 
epdisode was 2.00. An average of 2. 20 materials per episode were 
used in concentrated classes, which is significantly higher than 
the average of 1.86 materia^ls used in saturated classes. Teachers 
in concentrated classes were more likely to use materials purchased 
with EDY funds. 

Diverse use o/ materials apparently did not differ as a function of 
grade level, treatment condition or EDY classification. However, 
fourth grade pupils in concentrated classes used EDY materials more 
pften than fourth grade pupils In saturated classes. 

6. Teachers' ItH^erpersonal Style 

Teachers' interpersonal style was also observed during the teacher- 
focused observations. Behavioral data for each of the 56 teachers 
were combined across observations to form several indices of the 
teachers' interpersonal style or responsiveness. 
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Sunonary Conclusions (continued) 

Even though virtually all teachers displayed some supporltive affect, 
the display was relatively infrequent and at a low level of intensity. 
Host teachers took care to praise the students only when appropriate. 
The vast majority of teachers rarely commented or acted in a manner 
which Indicated disapproval of pupils' work or behavior. • 

Correlative analyst's of the affect variables revealed general findings 
regarding teachers' interpersonal style: Teacher praise and approvaV^^ 
are not related to criticism and disapproval. Essentially^ teachers 
who scored relatively high on the positive measures were neither more 
nor less likelyHhan^other teachers in the sample to score high on 
the negative tnonsuppor^ve) measures. Supportive and nonsupportive 
responsiveness appareptly functions as relatively independent components 
of these teachers' interpersonal styles. With the sample of second and 
fourth grade teachers, the interpersonal style was found to be related ^ 
more to grade than to treatment group, with teachers responding luore 
frequently to second grade pupils. 

7. Instructional Modes 

Second grade teachers in concentrated classes apparently made some 
distinctions between EDY.and non-EDY pupils. EDY pupils spent 
somewhat more time than non-EDY pupils in the responding mode. Non- 
EDY pupils spent more time receiving directions and completing 
seatwork and self-instruction tasks. Within saturated classes, the 
majority of time was fairly evenly dividejd between the responding 
mode and the seatwork/self-instruption mqde for both EDY and non- 
EDY pupils. 1_ 

The results from the fourth grade differed. Fourth grade teachers 
in both treatment groups did not make systematically different 
use of tf^e three instructional modes for EDY and non-EDY. Within 
the fourth grade, patterns were very similar within treatment type 
but very different between treatment type. Pupils in concentrated 
classes spent an average of half their time in seatwork and self- 
instruction. ,In saturated classes, teachers generally used the 
interactive mode for both EDY and non-EDY children. 
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Summary Conclusions (continued) 
8. Group Size 

Average g^otip size was about 10 in both the second and fourth-grade 
classes. Group size did not differ reliably between treatment groups 
In either grade. In the concentrated classes, groupings do not appear 
to differ between EDY and non-EDY pupils. In saturated second-grade 
classes, however, non-EDY pupils generally worked in smaller groups 
than EDY pupils. This distinction was not found in the fourth grade 
saturated classes. 

Results from the analysis of the outcome measures differ somewhat for the grades 
analyzed (2 and 4). More specifically, the results indicate the following: 

1. Fourth Grade Results 

A. Results of the analysis of covariance on the 28 fourthrgrade 
classes point to the following conclusions: 

For both the Total Reading and the Word Knowledge measures, 
concentrated services produced reliably greater mean scores 
than saturated services. These effects were evident before 
and after ajustment for process-context covariates (which 
include pre-scores). As distinct from second grade results, 
clear differences associated with treatment are found for 
these fourth-grade pupils on both Work Knowledge and Total 
Reading scales. 

Mean differences on Reading scores (a comprehension sub 
test) favored the concentrated condition. 

B. Fourth-grade multiple regression results point to the following 
conclusions: 

The significant process predictors are apparently in accord 
with findings reported in related res^ch. Specifically, 
there is consistently an Inverse relationship between the 
amount of time these pupils were engaged in noninstructional 
activities and outcome scores . (p<. 05). In other words, the 
more observed non1nstructi,onal time, the lower the subsequent 
scores. 
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Essentially, the relative within-district rank of EDY fourth- 
grade pupils receiving concentrated services^ increased by an 
average of 12 percentile rank units, wehreas their non-EDY 
counterparts stayed relatively stable (declined 3 percentile 
rank units). In comparison, the EDY fourth-grade pupils 
receiving saturated services increased their ranking only 
one percentile rapk- unit over, their relative within-district 
ranking the preceding year, while their non-EDY counterparts 
declined an average of nine percentile rank units. 

2. Second Grade Results 

A. The covariate analysis for the second grade indicates the following: 

Evidence for overall superiority for concentration or 
saturation did not approach statistical signiif icance. 
Even after adjusting for pre-test scores as covariables, 
differences and outcomes in terms of initial EDY status, 
remain highly significant. 

Evidence of differential effectiveness of treatment by 
EDY condition did not approach significance. 

B. Results of the regression analysis for seer. id grade outcomes point 
V to the following: ^ 

•'o'' those process measures which apparently account for signifi- 
cant proportions of criterion score variance (e.g., typical role- 
group leader and total number of minutes the pupil was observed 
ly to be idle), the anticipated relationships materialized different- 
ly than expected. For example, time-idle positively relates to 
outcome score, indicating that pupils with higher observed idle 
time score higher on the post-tests. This probably indicates 
that teachers spent more time with EDY pupils thereby neglecting 

non-EDY pupils at least during the one-time pupil observation ^ 
session. 

Results of the analysis indicate a substantial benefit may be associated with 
t:D?r> """"^*'3t^'"9 compensatory services, particularly in the upper elementary 
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grades (grade 4) • Such analyses, however, dp not identify the instructional ' 
components associated with these benefits. In" addition, these analyses do not 
evaluate other features of the instructional programs which may account for 
additional differences in Reading achievement. 

Using relative-wi thin-school-district status as the effectiveness-xriteritin, the 
concentration treatment is apparently superior to saturation. However, this 
Interpretation cannot be advanced' unequivocally since these patterns are at least 
partially influenced by regression toward the mean phenomenon inherent in pre-post 
analyses. 
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APPENDIX A: DEFINITION OF ROLE TYPES 



t. 



A.l TEACHERS 



A. 2 PUPILS 



A . 3 FREQUENCY /TEACHERS 



A. 4 FREQUENCY/PUPILS 
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APPENDIX A; 



DEFINITION OF ROLE TYPES 
A.l Teachers 
A. 2 Pupils 

A. 3 Frequency/Teachers 
A. A Frequency /Pupils 



APPENDIX B: 



ANALYSIS VARIABLES f 

B.l Classroom-Level Variables 

B.2 Legend for Classroom-Level Variables 

B.3 Pupil-Level Variables 

B.A Legend for Pupil-Level Variables 



APPENDIX C: 



INTERCORRELATION MATRIX FOR CLASSROOM-LEVEL 
ANALYSIS VARIABLES 



APPENDIX D: SUMMARY OF REGRESSION ANALYSIS 
D.l On Second Grade Pupils 

D. 2 On Fourth Grade Pupils 

APPENDIX E: REGRESSION RESULTS WITHOUT EDY STATUS 

E. l Second Grade 
E.2 Fourth Grade 
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APPENDIX G: 



FOUR-WAY ANALYSIS OF COVARIANCE FOR SECOND GRADE PUPILS 
F.l Word Knowledge - 1978 

F.2 Word Analysis - 1978 

F,3 Reading Comprehension - 1978 

F. 4 Total Reading - 1978 

DIFFERENCE SCORE ANAj[>rSIS FOR SECOND GRADE PUPILS 

G. l Word Knowledge 
G.2 Word Analysis - 
G.3 llbtal Reading 
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FOUR-WAY ANALYSIS OF COVARIANCE FOR FOURTH GRADE PUPILS 
H.l Word Knowledge - 1978 

H.2 Reading Comprehension - 1978 
H.3 Total Reading - 1978 
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DIFFERENCE SCORE ANALYSIS FOR 
J.l Word Knowledge 
1.2 Total Reading 
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DEFINITION OF HOLE TYPES— TEACHERS 



Instructional 

01 Assigning task 

03 Discussing 

04 Drilling 

05 Facilitating AV 

06 Facilitating manlpulatlves^ games* 

07 Facilitating oral/sllent Yeadln^ 

,08 Facilitating oral/^Uent reading, review 

09 Facilitating student work 

10 Instructing 

12 Facilitating creative work 

13 Reviewing 

15 Testing assessing 

16 Tutoring 

23 Facilitating readings writing 

26 Praising student work 

27 Facilitating ^her than reading 



Non Ins true t lonal 

02 Disciplining 

11 Interacting socially 

14 Story telling, reading aloud 

19 Managing 

22 Doing Nothing 

24 Reciting poetry 

25 Interrupted by office 
28 Talking with parent 

Unable to classify 

17 Can't tell, no English 

18 Can't tell 

21 Other, unclassified . 

20"^ No adult 

00 Not applicable 



Directive 

01 Assigning task 

02 Disciplining 
10 Instructing 

14 S^ory telling, reading aloud 

19 Managing 

24 Reciting poetry 

25 Interrupted by office 

26 Praising student work 
28 Talking with parent 



Teacher-initiated Interactive 

04 Drilling ' 

07 Faclllt2|tlng oral/sll^nt reading 

08 Facilitating oral/sllent reading, review 
13 Reviewing 

15 Testing, assessing 

16 Tutoring 



Discussl.on and social interaction 

03 Discussing 

11 Social interaction 



A 



Assisting and monitor ing 

05 "Facilitating AV 

06 Facilitating manipulatives, games 
09 Facilitating student work 

12 Facilitating creative work 
23 Facilitating reading, writing 
27 Facilitating other than reading 

Teacher idle 

22 Doing nothing 



Unable to classify 
17 



Can*t tell, not English 
Can't tell 
Other, unclassified 



21 



20 No adult 
00 Not applicable 
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DEFINITION OF ROLE TYPES—PUPILS 



Instructional 

01 Being assigned task \ 

03 Participating In discussion 

04 Responding to drill 

05 Using AV 

06 Using manlpulativeCy games^ . 

07 Oral/sllent reading 

08 Oral/sllent readings review 

09 Quiet task 

10 Being instructed 

12 Creative work 

13 Responding to review 

15 Being tested » assessed 

16 Being t^ored 

21 Tutorlt^y work with peers 

24 Readings writing ^ 

26 Other than reading | 

28 Reciting poems 

29 Play rehearsal 

31 Being praised » rewarded 

32 Leave room» to resource center 



Noninstructional 

02 B|eing disciplined 

11 Interacting socially 

14 Listening to story 

19 Being managed 

20 In transition I 

22 Not attending to tasl^ 

25 Leiave roomg personal"' reasons 

27 Clean up 

Unable to classify 

17 Can*t tell» not English 

18 Can't tell 

23 Other » unclassified. 
00 Not applicable ; 



Seatvork and self-instruction 

03 Partlclpatii:ig in discussion 

05 Using AV 

06 Using manipulativeSy, games 
09 Quiet task 

11 Interacting sixclaliy 

12 Creative work \ 

21 Tutoring » working with peers 

24 Reading » wriiing 

26 Other than reading 

27 Clean-up 

28 Reciting poems 

29 Play rehearsal ' 

32 Leave room^ to resource center 

Responding to teacher/group leader 

04 Responding to drill 

07 Oral/sllent reading / 

08 Orai/slient readings review 

13 Responding to review 

/ 15 Being tested » assessed 

" 16 Being tutored 



Receiving directions 

01 Being assigned task 

02 Being disciplined 
10 Being instructed 
14 Listening to story 

19 Being managed 

31 Being praised » rewarded 

Idle 

20 In transition 

22 Not attending to task 

Unable to classify 

17 Can* t tell » not English 

18 Cah*t tell 

23 Other* unclassified 

25^ Leave room, personal reasons 
00 Not applicable 
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APPENDIX B: ANALYSIS VARIABLES 



B.l ^ASsioOM-LEVEL VARIABLES 



B.2 LEG^D FOR CLASSROOM-LEVEL VARIABLES^ 

B.3 PUPIL-LEV^ VARIi^LES 

B.4 LEGEND FOR PUPIL-LEVEL VARIABLES 
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B.l Classroom-Level Analysis .Variables 



Grade 2 



Grade 4 



TotBl 



V4 
SO 



! nCAUC 

STAG 
V<77 

P377 
Ton 77 

CTrSV37 

Trsv:3 

TISV15 
C?I3737 

prsv:3 

PI 37 12 
PlSVtS 

STI.^I.NS 
STIMPASi 

STirtroLE 

XS0Y3ELB 

X?-Or«AT 

SPcDYflAT 

5?3TrM3 

NP3TXJ15 

S.-3TIM5 . 

XTTIMI . 

STTini 

STTI-6 

XTTrM7 

;<;C3N;S 

x:cc?£« 

.C.-073 

CTor;?73 



CASES 





0.5379 


23 


0.5S71 


0.1563 


0.1120 


0.0»33 


23 


0.252$ 


0.1555 


29 


I.51C5 


0.1:33 


23 


ICS. 3963 


19.7126 


23 


1.7143 


0,46:3 


23 


50.4354 


7.i:?4 


23 


M6.5732 


7.3::4 


27 


47.7132 


7.2611 


23 


47.6124 


6.9717 


C3 


1 .73C0 


1.0:33 


23 


7.8929 


1 .6532 


23 


2.0357 


1.6212 


* ' 23 


11.0357 


5.1439 


23 


1.7300 


1.0733 


23 


7.8?29 


1 .6332 


23 


2.05":;7 


1.6212 


23 


0.4:56 


o.s:43 


23 


11.0337 


5.1439 


23 


5.3?3> 


2.3V93 


23 


5.3321 


1 .6 97n 


23 


0.<f307 


1 .6331 


23 


1 .3419 


0.9352 


23 


0.9233 


) 0.2224 


23 


20.8402: 


; 21.0151 


23 


1 . 7016 


0.53?4 


23 


24.3596 


24.779t 


23 


21 . 76 33 


13.5111 


23 


17.56/6 


1 3.C91 5 


23 


9.41 13 


7.1492 


23 


10.9314 


7;3:21 . 


23 


3.4651 


1 .03:3 


23 


1.6652 


0.5424 


:^3 


1.471 3 


1 .47^)9 


23 


0.0269 


3.1417 


23 


119.03:9 


93.4233 , 


23 


0.1933 


0,3125 
3l5^;9 


23 


52.5;65 


23 


43.4379 


3.2991 


27 


49.9436 


4,6537 


23 


49.6$32 


4.1332 


23 









1 .5DC3 


0 .5C92 


b 0 


0,6010 


0.14:6 


23 


0.1224 


i).C747 


ra 


0.2T22 


0. 1 422 


c ^ 


1 .4913 


0 . C6 1 6 


■A 

vO 


124.2619 , 


15.3339 


m • 


1 .6371 


0.4973 




64 .CI 3t 


7.1532 


c 9 


55 .6370 


7.1439 


1 0 


63 .5c34 






62 . 8^41 


' . *• . to 4 


2 3 


2.0714 


• . 1 ^ to *4 


23 


A ^ 3 " 0 


1 . Tto • 1 


23 


* . w ^ / 1 


0.9315 


23 


0 A ^ 1 ^ 


5 , C4 1 0 


2 3 


9 7 f /. 
fc . U / I *• 


1 . 1524 


23 


£ T e * a 
0 . J V to ▼ 


1 . 1 C3 1 


23 


1 ■' C C 7 1 


0 . ?3l 5 


23 


V . J to 1 *4 


0 ,4756 


23 


▼ . C to I *♦ 


5 . C4 1 0 


23 




2 , 2C49 


23 


5 . £309 




29 


0 . 7502 


0 , ; ■•c S J, 


23 


1 .0226 




c9 


0 . 9-^37 


fl ^ * • 

U , w to J 


2 3 


31 . 2C^9 


29.2207 




1 .35:3 


0 .£ rsi 


c 3 


44.0743 


2 9.61 10 




23. 73:5 


1 6 . ?469 


• • 


27.0322 


1 1 . 6^6 1 


^ a 


3.6237 


7.3640 


29 


12.23^1 


e.3131 


23 


7. £163 


i.:^.;46 


23 


2.2612 


0,55:9 


23 


1 .6224 


1.5^35 


23v 


0.2411 


0.4233 


23 


63. ic:3 


44.3:63 


23 


0. 1071 


0.13:3 


23 


65.C67! 


6.C"31 


23 


59.6979 


4.2533 


10 - 


62.^579 


6.4- =6 


23 


63.4714 


6.2C31 


23 



MEAM 


STX^lPO bEV 


CASES 




0 ,5SC2 


56^ 


n c c n 


0. 1523 


56 


u . 1 i / £ 


O.C£:4 


56 


fl 9 T?^ 


0.t4Q3 


56 


1 .501/ 


0 .C376/ 


5i 


lie e A. A t 


19.7622 


56 


. i .0007 


0.4773 


56 




9. £617 


56 




. 6.2532 


37 


55.6516 


10.^633 


56 


55.2203 


I0.51C6 


56 


1.9107 


1 .1164 


S3. 


6. 1429 


1 .43:5 


56 


r.9464 


1.3131 


5^ 


10.42C6 


5.CSr»2 


56 


1 .9107 


1 . 1164 


56 


8.1429 


1 .4325 


56 


T.9464 


1 ,3131 


55 


0. 3753 




Six 


1 0 .4236 


5 , c : ; : 


55 


5.6227 


2.2639 


56 


5. 7C65 


2.c:6i 


56 


0.E655 


1 .2437 


56 


1'. 1623 


0.9736 


56 


0 . Y j / 0 




56 


CO . Ototo 5 


2:. (..5:5 


56 




0. 7229 


56 


J** . *• 0 9S 


23 • 6 339 


56 


^ ^ m »S 


1 7. 9 31 3 


56 




1311 76^/ 


56 


9.0177 




55 


11 .5673 


7.7316 


56 


8.14C6 


1.2151 


56 


1 .9647 


0.6945 


56 


1 .5469 


1 .4^39 


56 


0.1339 


0.3313 


56 


91 .1 114 


77. 1659 


56 


0.1503 


0.2412 


56 


59.0213 


6. 1^3^^ 


56 


51 .4312 


6.1639 


37 


56.4657 


6.6153 


56 


56.5673 


8.70^3 


56 
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B,2 Legend for Classrootn-level Analysis Variables 



00 

o 



VAROOl 

VAR002 

VAR003 

VAR004 

VARO05 

VAR006 

G^ADE 
VAR007 



PSPAN 
PNEGR 
PCAUC 
GEN 2 
AGE2 
STAG " 




ID 

RESPONDENT TYPE 
OBSERVER NUMBER 
SCHOOL CODE 
RESPONDENT CODE 
GRADE 

TREATMENT CODE 

1. SAT 

. 2. CONC 

PROPORTION SPANISH SURNAME PUPILS 

PROPORTION BLACK PUPILS 

PROPORTION CAUCASIAN PUPILS 

MEAN PUPIL GENDER OF TCHRS 78 CL^VSS 

(1EAN *PUPIL#AGE IN MONTHS OF TCHR^ 78 CLASS 

UNff-OF INSTRUCTION 

TOTAL CLASS 

2. STAGGERED READING 

MEAN .WORD KNOWLEDGE SCORE SPRING 77 
MEAN/WORD ANALYSIS SCORE SPRING 7'7 
I^MEA^N R€ADING SCORE SPRING 77 
MEAN TOTAL R EAD LNG * SCOR E SPRING 77 
TEACHER EXPERIENCE SCALE 

TEACHER TREATMENT IMPLEMENTATION SCALE 
TCH^PERCEIVED SALIENCE OF TREATMENT 
TCHR PROCESS'^DETERMINANTS SCALE 
PRINCIPAL EXPERIENCE SCALE 



CPISV07 

PISV08 

PISVI2 

PISVI5 

XTIMINS 

STIMINS 

STIMPAS2 

STIMIDLE 

XDIFMATL 

XEDYRELB 

SLEADER 

XPEDYMAT 

SPEDYMAT 

SPSt IM3 

XPSTIM5 

SPSTIM5 

XTTiMI 

STTIMI 

STTIM6 

XTTIM7 

XPOSNEG 

XCPOPER 

CWK7 8 

CWA78 

tRD78 

CT0TR78 



PRINCIPAL TREATMENT IMPLEMENTATION SCALE 



PRIN PERCEIVED SALIENCE OF TREATMENT 
PRIN OPINION OF FUNDS ALLOCATION 
PRIN PROCESS DETERMINANTS SCALE 



\ 



IND OBS TIME I N \ I N STF^UCT I ONAL ROLES-ME 
iInd OBS TIME IN INSTRUCTIONAL ROLES-SD 
iND OBS TIME IN RECEPTIVE ROLES-SD 
IND OBS TIME IDLE-SD- 

IND OBS NO OF MATERIALS USED-MEAN 
INd\0BS PERCENT OF EDY MATLS-MEAN 
IND DBS SCALED GROUP LEADEiRSH I P-SD 
TCH ^BS PERCENT OF EDY MATLS-MEAN' 
TCH OB^S PERCENT OF EDY MATLS-SD 
TCHR OBS PCT PUP.IL^TIME ACTIVE-SD 
TCH OBs\ PCT PUPIL TIME RECEPTIVE-MEAN 
TCH OBS PCT PUPIL' TIME RECEPTIVE-SD 
TCH OBS '^CHR T I ME I NSTRUCT I ON AL RCLES-MEA^ 
TCH OBS TCHR TIME INSTRUCTIONAL ROLES-SD 
TCH OBS TCHR TIME HELP PUPIL ACTr^SD 
TCH OBSTCHR TIME IDLE-MEAN 

supportive; X NONSU^PORTI VE AFFECT-MEAN 

\ 

COOPERATIVE BEHAVIOR-MEAN 

\ 

MEAN WORD KNOWLEDGE SCORE SPRING 7 8 
MEAN WORD^'ANALYSI S SCORE SPRING 78 - 
MEAN REApiN(^ SCORE SPRING 78 , 
MEAN TOTAL READING SCORE SPRING 78 
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B.3 Pupil-Level Analysis Variables 



t A5Li 



00 




I 



50 
I 
I 
I 
I 

I 

?,2 
3 
10 
I J 
I 
3 
C 
3 
J 
0 
3 
I 

t 1 
I I 



I 

•) 30 } 
4^31 

"J^"' 3 

'"^ ; 

2-01 
I 5= I 

3 0 30 
6-13 

^^--^ 

3 3vr~ 

3"^*3 

3 3-^0 
3 33 5 

3 ^ a X 

^ So 

4631 
5307 . 

I 2'^ 6^ 
3-^00 



Grade 2 

j7;.^jaaj 0£v ^ CASZ5 

0 • =5 0 I 0 M 3 

0 > Q. lie 

w*> 5 0 I a 115 

v>»e3i^ lie 

I U I 6 J7 i i 7 

3>2352 JU7 

vo 2 i 5-* 117 

^ i 9 i J 1 0 9 

>a 6 3 79 133 

0.0 9 

^ *^54 n 5 

u> "s3 03 1 1 3 
J3^*777i 

o» f»225 1 1^ 

^ 5 57 1 1 3 

7»=;02J I 13 

0 2 ^ 6 113 

3» 3 3 96 113 

0^6 2 02 M 3 

J. 6-^3 U3 

i^^7J33 M3 

0 > 2 6 € 3 / 113 

J. 2 6-; 4 / 113 

0 ) 3 0 .3 7 / I I 3 

0*3137/ 113 

l>2597/ 117 

u» 3 ^ 30^ I I 7 

?o 5 3 0.2' I 0 3 

i7>20e8' 100 

7.°. 5 32 10^ 



Grade 4 



1 



, I > 5 3C J 
^ I 00 } > 
I > " 0 ) > 
I ; 
- 0 1 7 i ^ ! 
, 7.77 -> 

* J > ^ - 
^ - • I ? 



) 1 




r r } ^ 


I ) 




I ) 


3 • ^ A 


1 , 


1' ; - '$ 


1 1 


a * - ^ 


I 0 ' 




I ) 


J7 


' "^l 


3 


3^ 


0 1*'-: 


1 








I ) 






I > I 




? 


0 , 




0, 


- V- 1 


O-j 


"vi3 3 




t-l 0 


1 ) 


0 2">3 


^> I22t 




3 







> 'J 



J - 3 i V 
v> 3 )2 ^ 

0 '3 0 J r 
' 0 i ^ 3 •* «* 

1 J 3 

l Jj 2 7 

A <i >o .; £ c 
1 I # 7 3 f I 

y> 0 

I ^ > v> ) 2 P 
-?>0 

Oi a > 7 7 

3 0 7 9 

t 3 vc 
Oj2 0v3 
J 4 9 0 -1 
oi57 J 
I la I 2 C ^ 
I J -J 4 ; = 

J i 3 -i C 

0 J J 2 -: 

• 2 o I I 

Oja 333 
J J 3 5 0 

Oi93f^» 
332*^ 
Uj 0 

3 » U 5 J 7 



C A 2 ^ 5 

102 
102! 
102 
102 
101 
3 '4 

lOl 

* -t 

• * 

10^ 
10 1 
101 
102 
102 
102 
10 2 
102 
1 32 
102 
1 )^ - 
I )2 
7 3 
102 

;9 

. i 3 
' 93 
0 
93 



ERIC 



8-< 



8. 



fv^\ • : :^, 
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B.A Legend for Pupil -Level Analysis 


Variables 


VAROOl 


SCHOOL CODE 




VAR002 


PUPIL ID ' 




VAR003 


TEACHER CODE \ 




VARpOA 
VAROOs' • 


TREATMENT 1=C0NS. 2=SAT. 




GRADE 




VAR006 


GENDER 1=MALE, 2=P1EMALE 




VAR007 


ETHNICITY 1=SPN 2=NGR 3=CAU A=OTH 




VAR008 


INDIV OBS FLAG 




VAR009 


WORD KNOWLDGE 77 . 




VAROlO 


WORD ANALYSIS 77 




YAROll 
VAR012 


READING COMP 78 'r 




TOTAL READING 77 




VAR013 


WORD KNOWLDGE 78 




VAR014 . 


WORD ANALYSIS 78 




_ VAR015 


TOTAL READING 78 . 




FALL 


FALL 77 AS PRESCORE FLAG 1=YES 




XSTAG 


AVERAGE STAGGERED RDG., STA ^2 \ 




VSTAG 


SD STAGGERED VS TOTAL CLASS RDG 


• 


XECY 


EDY STATUS. .1=YES 2=N0 




XNROLES 


MEAN NO OF ROLES CODED 




VNROLES 


SD NO OF ROLES CODED 




- XGRPSIZ 


AVERAGE INSTR GROUP SIZE 




VGRPSIZ 


VARIABILITY OF INSTRU GROUP SIZE 




STIMINS . 


TOTAL MINUTES INSTR TIME • ' 




STIMNIN 


TOTAL MINUTES NONINSTR TIME 




STIMACT 


TOTAL MINUTES PUPIL ACTIVE ROLES 




S.TIMRSR 


TOTAL MINS PUPIL RESPONDING ROLES 




STIMPAS2 


TOTAL MINS PUPIL PASSIVE ROLES 




StiMIDL 


TOTAL MINUTES PUPIL IDLE ' • 




"XUSEDY 


AVERAGE USE OF EDY MATERIALS 




, ; VUSEDY 


VARIABILITY IN USE OF EDY MATLS 




XDIFMATL 


AVERAGE USE OF DIFFERENT MATLS 




VDIFMATL 


VARIABILITY IN USE OF DIFF MATLS 




'XLEADER 


TYPICAL ROLE-GROUP- LEADER 

'A 




VLEADER 


VARIABILITY IN ROLEHPROUP LEADER 


■ ' f 


DWK 


DIFFERENTML WORD KNOWLEDGE 




DWA 


DIFFERENTIAL WORD ANALYSIS 


\. 


DTOTR 


DIFFERENTIAL TOTAL READING 


\ 


ERIC 


82. 
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APPENDIX C: INTERCORRELATION MATRIX FOR CLASSROOM-LEVEL 
ANALYSIS VARIABLES 



ERIC 
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Appendix C: Intercorrelation Matrix for Classroom-level Analysis Variables 



PCJIIX 



GVtZ 



AGtZ 



STAG 



2 




ISK77 


WA77 


9077 


56 ■ 




3 V . 


54 ■ 


i'f 37. 


C4 
37 . 


5t • 


37. 


56 . 


Sk • 


37. 


56 . 


56 • 


37. 


56 . 


56 • 




56 . 


54 • 




56 . 


56 • 


* 37 


56 . 


0*93S57 


37 . 


37 . 


0.96 I^S 


0. 9t 1 7t 


56 . 


0.99St t 


0.94250 


0.99! 74 


0.07252 


0.0691 3 


0 . t C66 1 


0.09^36 


-0 .2t 41^ 


—0 • 0S6c4 


-0.224f S 


-0.21 070 


-0.13103 


-0.39452 


-0.0710*2 


-0.27702 


■^0.07252 


O.C69t3 


0.tC66t 


o: 09436 


-0.2t4U 


-0.036C4 


-0.22493 


-0.2I0'»9 


-0.13133 


-0.1343* 


-0.03347 


-0.14141 


-0.3C&52 


-0.07132 


-0.2773: 


IKt«509 


0.t30C4' 


0.14240 


' 0.16253 


0.10133 


0.14240 


-0.03502 


0.01509 


0.C9177 


-0.20402 


-0.t47C0 


-0.13771 


0.07tt9 


0.IS342 


0.11992 


0.2t04S 


0.14725 


0.16£30 


0.04933 


-0.03349 


0.00200 


0.4075S 


0.19937 


0.42629 


0.25933 


0.17691 


0.26747 


0.15660 


0.16557 


0.17737 


-0.06574 


0.03739 


0.02470 


0.07S12 


0.077':s 


0.14430 


-0.19671 


-0.20164 


-0.24251 


0. 26031 


0.:4tt4 


0.26379 


-0.0074S 


-0.C347I 


0.0076S 


0.32799 


0.32175 


0.32641 


-0.21971 


-0.22424 


-0.24974 


-0.06700 


0. 07293 


-0.05913 


0.70407 


0.49&t3 


0.74S75 


0.50930 


0. 45361 


0.60940 


0.49743, 


0.46039 


0.75356 


0.7046S 


0.44036 


0.74991 



T0Tf?77 


TISVOI 


CTISV07 


TI5VC0 


TI5V15 


PZ5V0t 


56 . 


56 . 


54 . 


54. 


56. 


54. 


54 . 


56 . 


54. 


56. 


56. 


54. 


54 . 


56. 


56. 


56. 


56. 


56. 


56 . 


56 . 


54. 


54. 


56. 


56. 


56 . 


56. 


56. 


54. 


56. 


56. 


, 54 . 


' 56 . 


56 . 


56. 


56. 


56. 


56 . 


56 . 


56. 


56. 


54. 


54. 




56 . 


56. 


56. 


56. 


54. 


- 37 . 


37. 


37. 


37. 


37. 


37. 


54 . 


56. 


56. 


56. 


56. 


54. 


56 . 


56 . 


56 . 


56. 


56. 


56. 


0 . 0 9 '« 3 9 


56 . 


56* 


56 . 


56. 


56. 


**0 . 01 32S 


—0. 12911 


56 . 


54 . 


56. 


56. 


-0. 10''99 


0 .02140 


-0 . 053S5 


56 . 


56. 


56.. 


-0.2dS6^ 


0.061 32 


-0.05350 


0.063SO 


54 . 


33 . 


0.e9'V39 


1.09399 


-A. 12331 


0.02149 


0.C4132 


56. 


-0.01325 


-0.12331 


1.C9000 


-0.05355 


-0.05350 


-0.12431 


-0.10970 


0.02149 


-0.05395 


1.09990 


0.CS52O 


0.02140 


-0.15330 


0.12910 


-0.10373 


-0.194*4 


0.13177 


0.12910 


-0.23364 


O.Ci132 


.^0. 45350 


0.05520 


1.09090 


0.06132 


0.14157 


-0.13470 


-0.pl499 


-0.09629 


0.0?309 


•0.13470 


0.17331 


-0.07125 


-0,01910 


-0.07655 


0.C5139 


-0.09125 


-0.0156 7 


-0.0(660 


-0.14399 


0.10910 


0.10397 


-0.01460 


-0.19792 


-0.02C39 


rO. 04^40 


0.13153 


-0.C6195 


-0.02090 


0.09t03 


-O.C434^ 


-0.11 199 


-0.16936 


0.07993 


-0.04344 


0.1S52S 


-0.04344 


0;ISS57 


-0.12553 


0.05939 


-0.04344 


0.02375 


■-0. 07505 


-0.00955 


-0.17437 


-0.09929 


-0.075C5 


0.42743 


' 0.C3991 


' 0,C0732 


-0.10925 


0.13539 


0.09991 


0.26641 


0.3C4S2 


-0.e6297 


0.07110 


-0.03241 


0.30452 


0.1727S 


-0.C5452 


0.11392 


-0.04070 


0.15344 


-0.05452 


-0.01075 


0.06773 


0.17494 


' 0.09642 


0.07390 


0.C6795 


0.12141 


0.09273 


0.09394 


, 0.12224 


0.1C337 


0.0?27S 


-0.22920 


-0*17S79 


-0.21497 


0.00729 


0. 17007 


-0.17579 


0.27354 


0.03723 


0.^3691 


0.04621 


•0.0196S 


0.09723 


0.C9932 


-0.17245 


-6.0153S 


-0,. 09929 


0.14942 


-0.17245 


0.32634 


0.15574 


0.00205 


-0.13432 


-0.23979 


0.15594 


-0.22176 


-0.13597 


0.1 7304 


0.10374 . 


0.01993 


-0.13597 


-0.05120 


-0.27277 


-0.05430 


0.11412 


0.14334 


-0.27277 


0.73497 


0.13242 


0.12962 


-0.07691 


-0.2322S 


0.t!:42 


0.41S6O 


0.25343 


0.11274 


0.03732 


-0.C3474 


0.25349 


0. 75654 


0.19394 


0.09421 


-0.1223J 


-0.1 7637 


0.19376 


0.73904 


0.19242 


0.13lU 


«>0. 14573 


-0.12i54 


0.19242 



CPI9V97 PX9VC0 



56. 
56. 
56. 
54. 
56. 
54. 
54. 
54. 
37. 
54. 
56. 
56. 
56. 
-56. 
56. 
56. 
56. 
-0.05395 
-0. 10393 
-0.05350 
-0.01499 
-0.01910 
-0.14395 
-0.04949 
-0.11190 
0.13057 
-0.00933 
0.00732 
-0.04297 
0.11372 
0.17434 
0.09694 
-0.21497 
0.23691 
-0.01535 
0.00295 
0.17394 
-0.05459 
0.12962 
0.11274 
0.09421 
0.13114 



56. 
54. 
56. 
56. 
56. 
56. 
56. 
56. 
37. 
56. 
56. 
56. 
56. 
56. 
56. 
56. 
56. 
56. 
-0.194J6 
b.C9S20 
'•0.C5629 

-o.crijs 

- ^ 

0.13163 
-0.16936 * 
-0.12353 
-0.17437 
-0.IC325 
0.07119 
-0.04079 
0.09642 
0.12224 
0.C9725 
0.C462I 
-O.C:927 
-0.13432 
0.10374 
0.1J612 
-0.0;69f 
0.03732 
-0.12211 
-0.14573 



ERLC 



9. 



Appendix C (conCinued) 



00 



VA?317 

AZiZ 

5Ti3 

fc.:<77 

UA77 

B077 

T0T57T 

TX5V3I 

CTISV37 

Txsvrs 

1 TISV15 

i C?I5V37 
. FISVCS 
* PI 571 1 * 
PiSVtS 

XTi«:?is 
xoxrriTt 

s?STir.J 

XTT:r-l 

sm.ni 
»tt:.-4 
:<rT:n/ 

C-sTS 



S4. 

54 *i 
S». 
5S^ 

56/ 

54. 

SS. 

37. 

56. 

5i. 

56. 

56. 

56. 

56. 

56. 

56. 

56. 

56. 
0.t>t77 
•0.tSii75 
•0.14540 
•O.lfrflOf 
O.Of^aS 

o.e63e6 

O.C6i64 
0.0766S 
0.01620 
O.C«026 

-o>is:6 

-0.127g2 

•o.i2:2<> 

0.Z1S51 
0.07U1 
O.IVSiS 
-O.Ci335 

o.M;^a 

-O.tfl^l I 

-o.:53i^? 

-0.16:S6 
-0.i6CJ2 



XTIMI^S 5TWIK5 5TItt?AS2 STXnXOlt XOlfnxM XE0n5l3 SICADW XF£0T?1AT SPEOTMAT 



56. 
56. 

56. ' 

56. 

56. 

56. 

56. 

56. 

37. 

56. 

56. 

56. 

56. 

56. 

56. 

56. 

56. 

56. 

56. 

56. 
0,0f937 
O.C5t30 
0.t0337 
•0.061^5 
0.07m 
0.C331V 

.r.c59:f 

\l. 11519 

-».oi:6i 

0.tS!4(^ 
0.07133 
0. 10237 
0. 17707 
•0.01^65 
0.1^9^2 

-o.:53r? 

0.01^31 
0.t613^ 
-0.21:25 
* •O.CIiTi 
• 0. 171> J7 
•O.lfSS^ 



56. 

56. 
56. 
56. 
56. 
56. 
56. 
56. 
S7; 
S6. 
Si. 
56. 
56. 
56. 
56. 
56. 
56. 
56. 
56. 
56. 
56. 

o.ezc^i 

O.SlSZf 
0.2!211 
0.3f3i9 
0.»'-;6S 
0.1*50$ 
0.14127 
.0.1SC6I 
O.lOlU 
0.t2533 
0.1^120 
0.055S6 

>o.ti:s6 

0.02'J5^ 
>0.0I ID 
O.C6t:3 
O.OZllf 

o.:7iti 

•>0.C^6^0 
O.U'JV') 
0.19^61 



56. 
^6. 
56. 
56. 
56. 

56. 

56. 

56. 

17* • 

56. 
' 56. 

56. 

56. 
' 56. 

56.' 

56. 

56. 

56. 

56. 

56. 

56. 

56. 
0.24671' 
0.12665 
0.2S;i62 
0.09755 
0.21249/ 
0.12124 
0.19530 
0. 0^576 
0.115^0 
0.11911 

o.i4o<.a 

0e616 

01.3* 

211-3 
C3:51 

e^4v: 

27iC0 
0.CS117 

o.2or^J 

0.2i;»72 









56. 




56. 




56. 




56.. 


56. 


56. 




56. 




56. 


1 


56. 




56. 




56. 


56. 


56., 




56. 




56. 


; 


56. 




56. 




56. 


56. 


56. 




56. 




56. 




56. 




56. 




56. 


56. 


56. 




56. 




56. 




56. 




56. 




56. 


56. 


56 . 




56. 




56; 




56. 




56. 




56. 


56. 


56. 




56. 




56. 




56. 




56. 




56. 


56. 


56. 




56. 




56. . 




56. 




56. 




56. 


" 56.^ 


56. 




•37. 




37. 




17. 




37. 




17. 


17/ 


17^. 




56. 




56. 




56. 




56. 




56. 


56. 


56. 




56. 




56. 




56. 




56. 




^6. 


56. 


56. 




56. 




56. 




56. 




56. 




56. 


56. 


56. 




56. 




56. 




56. 




56. 




56. 


56. 


56. 




' 56. 




56. 




56. 




56. 




56. 


56. 


56. 




'56. 




56. 




56, 




56. 




56. 


56. 


56. 




56. 




56. 




56. 




56. 




56. 


56. 


56. 




56. 




56. 




56. 




56. 




56. 


56. 


56. 




56. 




56. 




56. 




56. 




56. 


56. 


56. 




56. 




56. 




56. 




56. 




56. 


56. 


56. 




56. 




56. 




56. 




56. 




56. 


56. 


56. 




56. 




56. 




56. 




56. 




56. 


56. 


56. 




56. 




56. 




56. 




56. 




56. 


56. 


56. 




56. 




56. 




56. 




56. 




' 56. 


56. 


56. 


•0. 


19653 




56. 




56. 




56. 




56. 


56. 


56. 


b. 


11Si7 


-0. 


16&91 




56. 




56. 




56. 


56. 


56. 


-0. 


12551 


^0. 


17954 


-0 


0C|?71 




56. 




56. 


56. 


56. 


-0. 


0**65 


0. 


07656 


0 


061 09 


-0. 


10095 




56. 


56. 


56. 


0. 


0S922 


-0. 


2:3:5 


-0 


175i4 


0. 


53919 


-0. 


09327 


56. 


56. 


O.0S431 


-0. 


oi«9;i 


-0,072*9 


0. 


i:<.39 


-0 


1«7tl 


0.45621 


56. 


0 


2C697 


-0. 


246^3 


0 


27271 


0. 


:<372 


-0 


i:s:* 


0.09775 


0.09317 


0 


26641 


0. 


01051 


0 


0773^ 


0. 


01075 


-0 


16977 -0.0Ca35 


-0. 037^7 


0 


14616 


-0.C2926 


0 


.10979 


0.056U 


-0 


1K37 


0.07237 


0.0:666 


0 


02177 


-0 


10107 


-0 


19200 


•0. 


2:S35 


0.eS7:6 •0.0423^ 


-0.01C54 


-0 


01C64 


0 


05401 


0 


1753* 


0. 


-?::6 


-0 


U573 


0.1C311 


0.I56?6 


0 


15337 


-0 


166 33 


0 


07<»59 


0. 


11099 


•0 


1:911 


O.C5S31 


0.C^5I9 




.U437 


0 


173)7 


0 


10119 


0. 


ii6a: 


-0 


:6c:2 


0.03332 


-0.02753 


-I 


.23335 


0 


bi67S 


0 


eoic<» 


0. 


15527 


0 


16SC5 


O.CSS^6 


0.147C5 


0 


.2777? 


0 


C9'>77 


-0.OS97 


•0. 


llltl 


0 


116C5 •0.03121 


O.CSI 1 7 


-0 


.07! 16 


-0 


:6511 


■0 


225T5 


0. 


2^132 


-0 


14525 


0.27:J9 


0.03190 


• 0 


. 0;i3 33 


-0 


.11633 


-0.01167 


0. 


11t99 


-0 


22tC6 . 


O.03£53 


0.0569:i 


-0 


.03)); 


-0 


.:o jj6 


0 


264:: 


0. 


lf:i6 


-0 


07770 


a.zarei 


O.C60;S 


-0 


.09723 


-0 


.20933 


0 


:4ioi 


0. 


Z\5^Z 


-0 




0.3076<* 


O.CS;i92 



5?5TXfl3 


xpSTxrS 


S?5TI?i5 


XTTI.H 


STTIfll 


5rrx?^6 


56. 




$6 . 




56 . 




56. 


56. 


56. 


56. 




56. 




56. 




56. 


56. 


56. * 


56. 




56. 




56. 




56. 


56. 


56. 


56 . 




56. 




56. 




56. 


56. 


56. 


56 . 




56. 




56. 




56. 


56. 


56. 


56. 




56. 




56. 




56. 


56. 


56. 


56. 




56. 




56. 




56. 


56. 


56. 


56 . 




56. 




56. 




56. 


56. 


56. 


17 . 




37. 




37. 




17." 


17. 


37. 


56 . 




56. 




56. 




56. 


56. 


56. 


56. 




56. 




56. 




56. 


56. 


56. 


56 . 




56 . 




56. 




56. 


56. 


56. 


56 . 




56. 




56. 




56. 


56. 


56. 


56. 




56. 




56. 




56. 


56. 


56. 


56 . 




56. 




56. 




56. 


56. 


56. 


56. 




56 . 




56. 




56. 


56. 


56. 


56. 




56 . 




56. 




56. 


56. 


56. 


56'. 




56 . 




56. 




56. 


56. 


56. 


56 . 




56. 




56. 




56. 


56. 


5S. 


56 . 




56. 




56. 




56. 


56. 


5S . 


56. 




56 . 




56. 




56. 


56. 


56. 


56. 




56 . 




56. 




56. 


* 56. 


56. 


56. 




56 . 




56. 




56. 


56. 


56. 


56. 




56. 




56. 




56. 


56. 


56. 


56. 




56. 




56. 




56. 


56. 


56 . 


56. 




56 . 




56. 




56. 


56 . 


56 . 


56. 




56 . 




56. 




56. 


99 . 


56. 


56. 




56 . 




56. 




56. 


56 . 


56. 


56. 




56 . 




56. 




56. 


'*6 . 


56. 


56. 




56. 




56. 




56. 


56. 


56f 


-0.051 16 




56. 




56. 




56. 


56. 


56. 


-0 . 0737 1 


0 


02372 




56. 




56. 


5s! 


56. 


-0.29192 


-0 


1561 1 


-0,197<i7 




56. 


5«i- 


56. 


0.19767 


0 


22^91 


0 


19739 


-0 


7^567 


56. 


56. 


0.719:1 


•0 


09157 


-0 


1CC61 


-0 


oi;i4 


0.09161 


56. 


0. 21739 


-0 


C0;i62 


*0 


076S5 


-0 


601 19 


0.47C;6 


O.I^.5;3 


-0.C7141 


0 


15^109 


0 


C46I5 


0 


05740 


0.01127 


o.o:i5i 


0.:dlS5 


.0 


07?i1 


rO 


11671 


-0 


0C071 


f 0.077iiS 


0,16^^6 


o.!5;9t 


0, 


C3:i7 


0 


le^ill 


-0 


I9;i0i 


0,111?1 


0,11127 


0.421^1 


-0 


16767 


-0 


o;iC6i 


-0 


1 1039 


0.1 1167 


0.23257 


0.H575 


0 


062:0 


0 


15210 


-0 


i?:ii 


o.3:c:.i 


0.1K*S35 


0.15S9t 


0 


o6?:i 


0 


1 5379 


-0 


<»:c69 


0.3^:27 


0-12235 



XTTl:i7 

56. 
56- 
56. 
36. 
56. 
56. 
56. 
56. 

i?. 

56. 



56. 
56. 
56. 
59. 
56. 
56. 
56. 
56. 
56. 



^6. 
56. 
56. 
56. 
56,; 
56. 
56. 
56. 
56. 
56 . 
56. 



-O.CfJJJ 
-3.07;7J 
0.3^:71 

o.::3i: 

0.3-61: 
0.17151 




n 



9.) 



^ Appendix C vcuiicxuu«a; 



XPOS»;£C XCCOPER CUX7d CMA7d 



CRD 7a 



CT0TR7d 



VA«:37 
PS?AS 

G£N2 

UX77 

WA77 

W77 

T0n77 

IISVOI 

tT:SV07 

TISVC5 

TISVIS 

FISV»I 

CPI5VD7 

PISVC5 

'p:svi2 

PXSVIS 
XTIhlMS 

STtr.ICLC 
XCIF.'UTL 

5?£0ir:AT 

XTTlrtI . 
STTJ.H 
STTirtS 
XTTin7 

X?C2!:£5 

Cn37a 

CTCTa7d 




56. 
56. 
5S. 
56. 
56. 
56. 
56. 
56. 
37. 
56. 
56. 
56. 
56. 
56. 
56. 
56. 
56. 
56. 
56. 
56. 
56. 
56. 
56. 
56. 
56. 
56. 
56. 
56. 
56. 
. 56.. 
56. 
56. 
56. 
56. 
56. 
56. 
56. 
56. 
56. 
37. 
I 56. 
56. 



APPENDIX D: SU^IMARY OF REGRESSION ANALYSIS 



D.l ON SECOND GRADE PUPIL 



D.2 ON FOURTH GRADE PUPIL ^ — 



ERIC 



So 



87. 



APPEjKDDL D 
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